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Abstract 


After an introduction to systems controlled by computers, the book presents a 
coherent set of system identification methods and control design methods 
extensively tested on various applications. The implementation aspects are 
covered in detail and illustrated with practical examples. Methodological 
development related to problems encountered in practice are included. 
Additional material including software and computer routines are available on 
the website: 

http://www. gipsa-lab.grenobleinp.fr/~ioandore.landau/identificationandcontrol/) 
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Preface 


The extraordinary development of digital computers (microprocessors, 
microcontrollers) and their extensive use in control systems in all fields of 
applications has brought about important changes in the design of control systems. 
Their performance and their low cost make them suitable for use in control systems 
of various kinds which demand far better capabilities and performances than those 
provided by analog controllers. 

However, in order really to take advantage of the capabilities of 
microprocessors, it is not enough to reproduce the behavior of analog (PID) 
controllers. One needs to implement specific and high-performance model based 
control techniques developed for computer-controlled systems (techniques that 
have been extensively tested in practice). In this context identification of a plant 
dynamic model from data is a fundamental step in the design of the control system. 

The book takes into account the fact that the association of books with software 
and on-line material is radically changing the teaching methods of the control 
discipline. Despite its interactive character, computer-aided control design software 
requires the understanding of a number of concepts in order to be used efficiently. 
The use of software for illustrating the various concepts and algorithms helps 
understanding and rapidly gives a feeling of the various phenomena. 
Complementary information and material for teaching and applications can be 
found on the book website: 


http://www.gipsa-lab.grenobleinp.fr/~ioandore.landau/identificationandcontrol/) 
The Aim of the Book 

The aim of this book is to give the necessary knowledge for the comprehension and 
implementation of digital techniques for system identification and control design. 
These techniques are applicable to various types of process. The book has been 
written taking into account the needs of the designer and the user of such systems. 
Theoretical developments that are not directly relevant to the design have been 
omitted. The book also takes into account the availability of dedicated control 
software. A number of useful routines have been developed and they can be freely 
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downloaded from the book website. Details concerning effective implementation 
and on-site optimization of the control systems designed have been provided. 

An important feature of the book, which makes it different from other books on 
the subject, is the fact that equal weight has been given to system identification and 
control design. This is because both techniques are equally important for design 
and optimization of a high-performance control system. A control engineer has to 
possess a balance of knowledge in both subjects since identification cannot be 
dissociated from control design. The book also emphasizes control robustness 
aspects and controller complexity reduction, both very important issues in practice. 


The Object of Study 

The closed loop control systems studied in this book are characterized by the fact 
that the control law is implemented on a digital computer (microprocessor, 
microcontroller). This type of system is sketched in Figure 0.1. 

The continuous-time plant to be controlled is formed by the set of actuator, 
process and sensor. The continuous-time measured output y(t) is converted into a 
sequence of numbers {y(k)} by an analog-to-digital converter (ADC), at sampling 
instants k defined by the synchronization clock. This sequence is compared with 
the reference sequence {r(k)} and the resulting sequence of errors is processed by 
the digital computer using a control algorithm that will generate a control 
sequence {u(k)}. By means of a digital-to-analog converter (DAC), this sequence 
is converted into an analog signal, which is usually maintained constant between 
the sampling instants by a zero-order hold (ZOH). 


e(k) u(k) u(t) PLANT y(t) y(k) 


DIGITAL 
COMPUTER ActuatorH> Process Sensor 


Figure 0.1. Digital control system 


The Main Stream 
Figure 0.2 summarizes the general principles for controller design, implementation 
and validation. 

For design and tuning of a good controller one needs: 


1. To specify the desired control loop performance and robustness 

2. To know the dynamic model of the plant to be controlled 

3. To possess a suitable controller design method making it possible to 
achieve the desired performance and robustness specifications for the 
corresponding plant model 
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4. To implement the resulting controller taking into account practical 


constraints 
5. To validate the controller performance on site and, if necessary, to re- 
tune it 
Performance 
specifications 
Robustness METHOD 
specifications 


Reference 1 
>| CONTROLLER 


Figure 0.2. Principle of controller design and validation 


In order to obtain a relevant dynamic plant model for design, system 
identification techniques using input/output measurements (switch 1 is off, switch 
2 is on) should be considered. The methodology for system identification is 
presented in the book together with dedicated algorithms implemented as software 
tools. 

Once the system model is available, the book provides a set of methods (and 
the corresponding software tools) for the design of an appropriate controller. 

The implementation of the controller should take into account aspects related to 
data acquisition, switching from open loop to closed loop, and saturation of the 
actuator as well as constraints on the complexity of the controller. These aspects 
are examined in detail in the book. 


Expected Audience 
The book represents a course reference for Universities and Engineering Schools 
offering courses on applied computer-controlled systems and system identification. 

In addition to its academic audience, Digital Control Systems is aimed at 
practising engineers wishing to acquire the concepts and techniques of system 
identification, control design and implementation using a digital computer. The 
industrial references for the techniques presented in the book and the various 
applications described provide useful information for those directly involved in the 
real-world uses of control. 

Readers who are already familiar with the basics of computer-controlled 
systems will find in this book a clear, application oriented, methodology for system 
identification and the design of various types of controllers for single-input, single- 
output (SISO) systems. 
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The Content 

Chapter 1 briefly reviews the continuous-time control techniques which will be 
used later on as a reference for the introduction of basic concepts for computer 
control. 

Chapter 2 provides a concise overview of computer-controlled systems: the 
structure of these systems, the sampling process, discrete-time dynamic models, 
the principles of design of discrete-time two-degrees-of-freedom controllers (RST), 
and robustness analysis of the control loops. 

Chapter 3 presents several pertinent model-based design methods for discrete- 
time controllers operating in a deterministic environment. After the design of 
digital PID controllers, more general design methods allowing systems of any 
order, with or without delay, to be controlled are presented. The robustness of the 
closed loop with respect to plant model uncertainties or variations is examined in 
detail and appropriate control design methods that take into account robustness 
specifications are provided. 

The design of discrete-time controllers operating in the presence of random 
disturbances is discussed in Chapter 4. The chapter begins with a review of random 
disturbances and of models and predictors for random disturbances. Connections 
with design in deterministic environments are emphasized. 

The basics of system identification using a digital computer are presented in 
Chapter 5. Methods that are used for the identification of discrete-time models, and 
model validation techniques as well as techniques for order estimation from 
input/output data are described in Chapter 6. 

Chapter 7 discusses the practical aspects of system identification using data 
from several applications: air heater, distillation column, DC motor, and flexible 
transmission. 

The main goal of this work, the use of control design methods and system 
identification techniques in the implementation of a digital controller for a specific 
application, is discussed in Chapter 8. Implementation aspects are reviewed and 
several applications presented (air heater, speed and position control of a DC 
motor, flexible transmission, flexible arm, and hot-dip galvanizing). 

For on-site optimization and controller re-tuning a plant model should be 
obtained by identification in closed loop (switches 1 and 2 are on in Figure 0.2). 
The techniques for identification in closed loop are presented in Chapter 9. 

In many situations constraints on the complexity of the controller are imposed 
so Chapter 10 presents techniques for controller order reduction. 

Appendix A reviews some basic concepts. 

Appendix B offers an alternative time-domain approach to the design of 
RST digital controllers using one-step-ahead and long-range-predictive control 
strategies. Links and equivalence with the design methods presented in Chapter 3 
are emphasized. 

Appendix C presents a state space approach to the design of RST digital 
controllers. The equivalence with the design approach presented in Chapter 3 is 
emphasized. The linear quadratic control is also discussed. 

Appendix D presents some important concepts in robustness. 

Appendix E demonstrates the Youla—Kucera parametrization of digital 
controllers which is useful for a number of developments. 
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Appendix F describes a numerically robust algorithm for recursive 
identification. 

Appendix G is dedicated to the presentation of suggested laboratory sessions 
that use data files and functions which can be downloaded from the book website. 

Appendix H gives a list and a brief description of the MATLAB®*- and Scilab- 
based functions and C** programs implementing algorithms presented in the book. 
These functions and programs can also be downloaded from the book website. 

The book website gives access, to the various functions and programs as well 
as to data files. It contains descriptions of additional laboratory sessions and slides 
for a number of chapters, tutorials and courses related to the material included in 
the book that can be downloaded; all the MATLAB” files used for generating the 
examples and figures in the text can also be found on the website. 


How to Read the Book 

The book can be read in different ways after the basic control concepts presented in 
Chapters | and 2 have been assimilated. If the reader is mainly interested in control 
algorithms, it would be useful for him/her to read Chapters 3 and 4 and then 
Chapters 5, 6, 7 and 8. If the reader is mainly interested in identification 
techniques, he or she can jump straight to Chapters 5, 6 and 7 and then return to 
Chapters 3, 4 and 8. Those who are familiar with the basics of computer-controlled 
systems can even start with Section 2.5. Chapters 9 and 10 follow dependently 
from Chapter 8. Figure 0.3 shows the interdependence between the various 
chapters. 


Course Configurations 

A complete basic course on digital control should cover most of the material 
presented in Chapters 2, 3, 5, 8 and Section 4.1. For an advanced course, all 
chapters might be included. For an introductory course in digital control one can 
use Chapters 2, 3 and 8. For an introductory course on system identification one 
can use Chapters 5, 6 and 7. 


Why this Book? 
The book reflects the first author’s more than twenty-five years of experience in 
teaching, design and implementation of digital control systems. Involvement in 
many industrial projects and feedback from an industrial and academic audience 
from various countries in Europe, North and South America and Asia have played 
a major role in the selection, organization and presentation of the material. 
Experience from writing the book System Identification and Control Design, 
Prentice Hall, 1990! (information and System Sciences Series) has been also very 
useful. 

The present book is a revised translation of a book (Commande des systémes — 
conception, identification et mise en oeuvre) published in 2002 by Hermes- 
Lavoisier, Paris. 


' Revised taranslation of a book published by Hermes Paris, 1988 (second edition 1993). 
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Figure 0.3. Logical dependence of the various chapters 


The most recent academic courses based on the material in the present book 
include PhD courses delivered in 2004 at Universita Technologica de Valencia, 
Spain (robust discrete time controller design) and Escuela Superior de Ingenerios 
de Sevilla, Spain (system identification in open and closed loop). 
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Continuous Control Systems: A Review 


The aim of this chapter is to review briefly the main concepts of continuous control 
systems. The presentation is such that it will permit at a later stage an easy 
transition to digital control systems. 

The subject matter handled relates to the description of continuous-time models 
in the time and frequency domains, the properties of closed-loop systems and PI 
and PID controllers. 


1.1 Continuous-time Models 


1.1.1 Time Domain 


Equation 1.1.1 gives an example of a differential equation describing a simple 
dynamic system: 


dy 
dt 


1 G 
=-FyO+ uC) (1.1.1) 


In Equation 1.1.1 u represents the input (or the control) of the system and y the 
output. This equation may be simulated by continuous means as illustrated in 
Figure 1.1. 

The step response illustrated in Figure 1.1 reveals the speed of the output 
variations, characterized by the time constant T, and the final value, characterized 
by the static gain G. 
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u 


Figure 1.1. Simulation and time responses of the dynamic system described by Equation 
1.1.1 (I - integrator) 


Using the differential operator p = d/dt, Equation 1.1.1 is written as 


1 G d 
ae A rg ae (1.1.2) 


For systems described by differential equations as in Equation 1.1.1 we 
distinguish three types of time response: 


1. The “free” response: it corresponds to the system response starting with an 
initial condition (0)=yy and for an identically zero input for all t (u = 0, V 
t). 

2. The “forced” response: it corresponds to the system response starting with 
an identically zero initial condition y(0) = 0 and for a non-zero input u(t) 
forall t > 0 (u(t) =0,t< 0; u(t) + 0,t = Oandy(A =0 fort < 0). 

3. The “total” response: it represents the sum of the “free” and “forced” 
responses (the system being linear, the superposition principle applies). 


Nevertheless later we will consider separately the “free” response and the “forced” 
response. 


1.1.2 Frequency Domain 


The characteristics of the models in the form of Equation 1.1.1 can also be studied 
in the frequency domain. The idea is then to study the system behavior when the 
input u is a sinusoidal or a cosinusoidal input that varies over a given range of 
frequencies. 

Remember that 
jot 


e =cos@t+jsinat (1.1.3) 


and, consequently, it can be considered that the study of the dynamic system 
described by an equation of the type 1.1.1, in the frequency domain, corresponds to 
the study of the system output for inputs of the type u(t) =e. 
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Since the system is Jinear, the output will be a signal containing only the 
frequency o, the input being amplified or attenuated (and possibly a phase lag will 
appear) according to œ; i.e. the output will be of the form 


y(t) = H(ja)e!®' (1.1.4) 


Figure 1.2 illustrates the behavior of a system for an input u(t) = d”. 

However there is nothing to stop us from considering that the input is formed 
by damped or undamped sinusoids and cosinusoids, which in this case are written 
as 


u(t)=eFleJOt= (ot jot- est; saat jo (1.1.5) 


where s is interpreted as a complex frequency. As a result of the linearity of the 
system, the output will reproduce the input signal, amplified (or attenuated), with a 
phase lag or not, depending on the values of s; i.e. the output will have the form 


y(t) = H(s)e" (1.1.6) 


and it must satisfy Equation 1.1.1 for u(t) = e". 


log | H | 
u(t) =ejot = Hfin)elot 
——»]| SYSTEM wet H(jao)e! 
u(t) =est y(t) a H(s)est 


(A) 


Figure 1.2. Response of a dynamic system to periodic inputs 


From Equation 1.1.6 one gets 


WO _ 5 Hs) 9 (1.1.7) 
dt 


and by introducing Equation 1.1.7 in Equation 1.1.1, while bearing in mind that 
u(t) = e", one obtains 


(s +a) M(s)e" = ce" (1.1.8) 


l e't is an eigenfunction of the system because its functional properties are preserved when passing 
through the system (only the amplitude and the phase are modified). 


4 Digital Control Systems 


H(s), which gives the gain and phase deviation introduced by the system of 
Equation 1.1.1 at different complex frequencies, is known as the transfer function. 
The transfer function H(s) is a function of only the complex variable s. It 
represents the ratio between the system output and input when the input is e“. From 
Equation 1.1.8, it turns out that, for the system described by Equation 1.1.1, the 
transfer function is 


A(s)= 


(1.1.9) 
l+sT 


The transfer function H(s) generally appears as a ratio of two polynomials in s 
(H(s)=B(s)/A(s)). The roots of the numerator polynomial (B(s)) define the “zeros” 
of the transfer function and the roots of the denominator polynomial (A(s)) define 
the “poles” of the transfer function. The “zeros” correspond to those complex 
frequencies for which the system gain is null and the “poles” correspond to those 
complex frequencies for which the system gain is infinite. 

Note that the transfer function H(s) can also be obtained by two other 
techniques: 


e Replacing p by s in Equation 1.1.2 and algebraic computation of the y/u 
ratio. 
e Using the Laplace transform (Ogata 1990). 


The use of the representation of dynamic models in the form of transfer 
functions presents a certain number of advantages for the analysis and synthesis of 
closed-loop control systems. In particular the concatenation of dynamic models 
described by transfer functions is extremely easy. 


1.1.3 Stability 


The stability of a dynamic system is related to the asymptotic behavior of the 
system (when ¢— © ), starting from an initial condition and for an identically zero 
input. 

For example, consider the first-order system described by the differential 
Equation 1.1.1 or by the transfer function given in Equation 1.1.9. 

Consider the free response of the system given in Equation 1.1.1 for u =0 and 
from an initial condition y(0) = yo: 


dy 1 
—+—y(t)=0; (0) = 1.1.10 
di r) ¥(0) = yo ( ) 


A solution for y will be of the form 


y(t) = Ke“ (1.1.11) 
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in which K and s are to be determined?. From Equation 1.1.11 one finds 


A yke” (1.1.12) 
dt 


and Equation 1.1.10 becomes 
st 1 
Ke™| s+—|=0 (1.1.13) 
T 
from which one obtains 
l K (1.1.14) 
j=- KE wl. 
T Yo 


and respectively 


y(t) = ype T (1.1.15) 
The response for T > 0 and T < 0 is illustrated in Figure 1.3. 


Yo 


T<o 


T>o 


t 


Figure 1.3. Free response of the first-order system 


For T > 0, we have s < 0 and, when t > œ, the output will tend toward zero 
(asymptotic stability). For T < 0, we have s > 0 and, when t > œ , the output will 
diverge (instability). Note that s = -//T corresponds to the pole of the first-order 
transfer function of Equation 1.1.9. 

We can generalize this result: it is the sign of the real part of the roots of the 
transfer function denominator that determines the stability or instability of the 
system. 

In order that a system be asymptotically stable, all the roots of the transfer 
function denominator must be characterized by Re s < 0. If one or several roots of 


2 The structure of the solution for Equation 1.1.11 results from the theory of linear differential 
equations. 
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the transfer function denominator are characterized by Re s > 0, then the system is 
unstable. 

For Re s = 0 we have a limit case of stability because the amplitude of y(t) 
remains equal to the initial condition (e.g. pure integrator, dy/dt = u(t); in this case 
y(t) remains equal to the initial condition). 

Figure 1.4 gives the stability and instability domains in the plane of the 
complex variable s. 

Note that stability criteria have been developed, which allow determining the 
existence of unstable roots of a polynomial without explicitly computing its roots, 
(e.g. Routh-Hurwitz’ criterion) (Ogata 1990). 


Figure 1.4. Stability and instability domains in the s-plane 
1.1.4 Time Response 


The response of a dynamic system is studied and characterized for a step input. 
The response of a stable system is generally of the form shown in Figure 1.5. 


Maximum overshoot (M) 


Final value (FV) 
(steady state) 


Figure 1.5. Step response 


The step response is characterized by a certain number of parameters: 


e tp (rise time): generally defined as the time needed to reach 90% of the 
final value (or as the time needed for the output to pass from 10 to 90% of 
the final value). For systems that present an overshoot of the final value, or 
that have an oscillating behavior, we often define the rise time as the time 
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needed to reach for the first time the final value. Subsequently we shall 
generally use the first definition of tp. 


e ty (settling time): defined as the time needed for the output to reach and 
remain within a tolerance zone around the final value (+ 10%, + 5% + 2%). 

e FV (final value): a fixed output value obtained for t— œ. 

e M (maximum overshoot): expressed as a percentage of the final value. 


For example, consider the first-order system 


G 


H(s)= 
(s) l+sT 


The step response for a first-order system is given by 
y(t) =GU-e"") 


Since the input is a unitary step one has 

FV = G (static gain); tp = 2.2 T 

ty = 2.2 T (for + 10% FV) ; ts=3 T (fort 5%FV); M=0 
and the response of such a system is represented in Figure 1.6. Note that for t = T, 
the output reaches 63% of the final value. 


Figure 1.6. Step response for a first-order system 


1.1.5 Frequency Response 


The frequency response of a dynamic system is studied and characterized for 
periodic inputs of variable frequency but of constant magnitude. For continuous- 
time systems, the gain-frequency characteristic is represented on a double 
logarithmic scale and the phase frequency characteristic is represented on a 
logarithmic scale only for the frequency axis. 
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20 log IHG o) | Resonance GAIN 


a 


dB 


2 second order (40 — 
3dB ( Jec? 


y 


: dB 
` first order — 
a Ge dec ) 


B @=2n f 


oO 


( f 


Figure 1.7. Frequency responses 


The gain G(@) = |H(jo)| is expressed in dB (|H(j@)| dB = 20 log |H(a)|) on 
the vertical axis and the frequency œ, expressed in rad/s (@ = 2af where f 
represents the frequency in Hz) is represented on the horizontal axis. Figure 1.7 
gives some typical frequency response curves. 

The characteristic elements of the frequency response are: 


e fy(@p) (bandwidth): the frequency (radian frequency) from which the zero- 
frequency (steady-state) gain G(0) is attenuated more than 3 dB; 
G(@,) =G(0)-3dB; (G(@,) = 0.707 G(0)). 

© fA @c) (cut-off frequency): the frequency (rad/s) from which the attenuation 
introduced with respect to the zero frequency is greater than N dB; 
G(ja@-) = G(0)-NaB. 

e Q (resonance factor): the ratio between the gain corresponding to the 
maximum of the frequency response curve and the value G(0). 

e Slope: it concerns the tangent to the gain frequency characteristic in a 


certain region. It depends on the number of poles and zeros and on their 
frequency distribution. 


Consider, as an example, the first-order system characterized by the transfer 
function given by Equation 1.1.9. For s = jæ the transfer function of Equation 1.1.9 
is rewritten as 


Ho) = = HGae® = Hgo) (1.1.16) 


where |H(jo)| represents the modulus (gain) of the transfer function and < po) 
the phase deviation introduced by the transfer function. We then have 


G(o) = |H(jo)| = ——— (1.1.17) 


+o T’) 
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_ a} IimGG@)}_ ap. 
Z(q@) = tan meya tan [- oT (1.1.18) 


From Equation 1.1.17 and from the definition of the bandwidth œg, we obtain: 
Oz =1/T 


Using Equation 1.1.18, we deduce that for œ = wg the system introduces a phase 
deviation 2? (0p) = -45°. Also note that for œ = 0, G(0) =G, Z9 (0) = 0° and 


for o> 0, G(o)=0, 79 Cæ) =-90°. 

Figure 1.8 gives the exact and asymptotic frequency characteristics for a first- 
order system (gain and phase). 

As a general rule, each stable pole introduces an asymptotic slope of -20 
dB/dec (or 6 dB/octave) and an asymptotic phase lag of -90°. On the other hand, 
each stable zero introduces an asymptotic slope of +20 dB/dec and an asymptotic 
phase shift of +90°. 

It follows that the asymptotic slope of the gain-frequency characteristic in dB, 
for high frequencies, is given by 


AZ = (n= m)x204B | dec (1.1.19a) 
a) 


where n is the number of poles and m is the number of zeros. 


BODE diagram 
0 0 
} oo gain 
phase 
10 -22.5 
first order: tt 
tte 
[dB] [Deg] 
20 -45 
30 -67.5 
-40 1 -90 
10° 10" 10° 10° 10° 
@ [rad/s] 


Figure 1.8. Frequency characteristic of a first-order system 
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The relation 
Zo(«) = —(n — m)x90° (1.1.19b) 


gives the asymptotic phase deviation. 
Note that the rise time (tg) for a system depends on its bandwidth (œg). We 
have the approximate relation 


2to3 


OB 


(1.1.20) 


tr*® 


1.1.6 Study of the Second-order System 


The normalized differential equation for a second-order system is given by: 


d av) D 20 ) 


dt? 


+ 26a) —— + wp v(t) = wult) (1.1.21) 


Using the operator p = d/dt, Equation 1.1.21 is rewritten as 
(p° + 2600p + wp) YO) = would) (1.1.22) 


Letting u(t) = e in Equation 1.1.21, or p = s in Equation 1.1.22, the normalized 
transfer function of a second-order system is obtained: 


2 
M0 


H(s)= 
(s) s? +2 aostao 


(1.1.23) 


in which 
e @p: natural frequency in rad/s (@) = 2 fo) 
e ¢ : damping factor 


The roots of the transfer function denominator (poles) are 
a) |¢| < 1, complex poles (oscillatory response) : 


$1,2=-6 @p+j ao V1-C? (1.1.24a) 


(œN 1- 2 is called “damped resonance frequency”). 
b) ¢ = 1, real poles (aperiodic response) : 
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s125- +o VC2-1 (1.1.24b) 


The following situations are thus obtained depending on the value of the damping 
factor ¢: 


e ¢> 0: asymptotically stable system 
e ¢<0: unstable system 


These different cases are summarized in Figure 1.9. 


Figure 1.9. The roots of the second-order system as a function of ¢ (for |6] < 1) 


The step response for the second-order system described by Equation 1.1.21 is 
given by the formula (for |ó] < /) 


y(t) =1- e 6% (sin @y 1-7 t+ 8) (1.1.25) 


1 
vise 
in which 

0=cos! ¢ (1.1.26) 


Figure 1.10 gives the normalized step responses for the second-order system. This 
diagram makes it possible to determine both the response of a given second-order 
system and the values of wp) and ¢, in order to obtain a system having a given rise 
(or settling) time and overshoot. 

To illustrate this, consider the problem of determining @ and ¢ so that the rise 


time (0 to 90% of the final value) is 2.75s with a maximum overshoot ~ 5%. From 
Figure 1.10, it is seen that in order to ensure an overshoot ~ 5% we must choose 
¢= 0.7. The corresponding normalized rise time is: @p ty ~ 2.75. It can be 


concluded that to obtain a rise time of 2.75s, @» = J rad/sec must be taken. 


12 Digital Control Systems 


M % 


0,1 02 03 04 05 06 07 08 0,9 1 


Figure 1.11. Second-order system: a) maximum overshoot M as a function of the damping 
factor € ; b) normalized rise time as a function of ¢ 
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In order to make easier the determination of wy and ¢ for a given rise time tr and a 
given maximum overshoot M, the graph of M as a function of ¢ and the graph of 
@po tr as a function of ¢ have been represented in Figure 1.1 1a, b. 

The curve given in Figure 1.1la allows choosing the damping factor ¢ for a 
given maximum overshoot M. Once the value of ¢ chosen, the Figure 1.11b gives 
the corresponding value of œp tr. This allows one to determine @, for a given rise 
time fp. 

The functions omega damp.sci (Scilab) and omega_damp.m (MATLAB*) 
allow one to obtain the values of wy and ¢ directly from the desired overshoot and 
rise time. 


2"? Order Systems : Bode Magnitude Diagram 
BO cee Ses See ae tale ee les P geet ee ae eoe x SN gee an 3 


Magnitude (dB) 


¢= 0.1, 0.3, 0.5, 0.7, 0.9 


Frequency (o/o,) 


Figure 1.12. Normalized frequency responses of a second-order system (gain) 


The settling time ts, for different values of ¢ and of the tolerance zone around 


the final value, can be determined from the normalized responses given in Figure 
1.10. 

Figure 1.12 gives the normalized frequency responses for a second-order 
system. 


3 To be downloaded from the book website. 
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1.1.7 Systems with Time Delay 


Many industrial processes exhibit a step response of the form shown in Figure 
1.13. The period of time during which the output does not react to the input is 
called time delay (denoted by 7). 

A first-order dynamic system with a time delay 7 is described by the following 
differential equation: 


dy 
dt 


= =H) + Lut T) (1.1.27) 


where the argument of u(t - 7) reflects the fact that the input will act with a time 
delay of t. Equation 1.1.27 is to be compared with Equation 1.1.1. 
The corresponding transfer function is 


Ge 
l+sT 


(1.1.28) 


H(s)= 


in which es? represents the transfer function of the time delay z. 


] 
<_- t = 


Figure 1.13. Step response of a system with time delay 


Equations 1.1.27 and 1.1.28 can be straightforwardly extended to high-order 
systems with time delay. 
Note that for the systems with time delay the rise time tg is generally defined 


fromt = T. 
The frequency characteristics of the time delay are obtained by replacing s=j@ 
in e57, We then obtain 
Hdelay (j @) =e JOT =| 1). 29) (1.1.29) 


with 


Z(@) =- @ t (rad) (1.1.30) 
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Therefore a time delay does not modify the system gain, but it introduces a phase 
deviation proportional to the frequency. 


1.1.8 Non-minimum Phase Systems 


For continuous time systems (exclusively), non-minimum phase systems have one 
or more unstable zeros. In the continuous time case, the main effect of unstable 
zeros is the appearance of a negative overshoot at the beginning of the step 
response, as it is shown for example in Figure 1.14. The effect of the unstable 
zeros cannot be offset by the controller (one should use an unstable controller). 


Time (s) 


Figure 1.14. Step responses of a non-minimum phase system (H(s)=(1-sa)/(1+s)(1+0.5s), 
a=1,0.5) 


As an example consider the system 


l-sa 


AS) = d+ 055) 


with a=1 and 0.5. Figure 1.14 represents the step response of the system. 
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1.2 Closed-loop Systems 


Figure 1.15 shows a simple control system. y(t) is the plant* output and represents 
the controlled variable, u(t) is the input (control signal) applied to the plant by the 
controller (manipulated variable) and r(t) is the reference signal. 


Controller 


Figure 1.15. Control system 


The control systems have a closed-loop structure (the control signal is a 
function of the difference between the reference and the measured value of the 
controlled variable) and contains at least two dynamic systems (the plant and the 
controller). 

We shall examine in this section the computation of the closed-loop transfer 
function, the steady-state error with respect to the reference signal, the rejection of 
disturbances and stability of the closed-loop systems. 


1.2.1 Cascaded Systems 


Figure 1.16 represents the cascade connection of two linear systems characterized 
by the transfer functions H (s) and H,(s). 


u4(t) =est y4(t) =H4(s) eSt = u2 y2 (t) 


Figure 1.16. Cascade connection of two systems 


If the input to H (s) is u; (f) = e“ the following relations are found: 


u(t) = yd) = H (s) e* (1.2.1) 
V(t) = H,(s) ux(t) = H,(s) H,(s) eS = H(s) est (1.2.2) 


4 the term “plant” defines the set : actuator, process to be controlled and sensor. 
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and we can conclude that the transfer function of two cascaded systems is 
H(s) = H (s) H (s) (1.2.3) 
or in the general case of n cascaded systems 


H(s) = H (8) H,,_(8).-.L(8) H (8) (1.2.4) 


1.2.2 Transfer Function of Closed-loop Systems 


Consider the closed-loop system represented in Figure 1.17. 


r(t) =eSt u(t) y (t) = Ho (8) eSt 


Figure 1.17. Closed-loop system 


The output y(4) of the closed-loop system in the case of an external reference 
r(t) = e* is written as 


y(t) = He, (s) e* = H (s) H (S) u) (1.2.5) 
But u (ô) is given by the relation 
u(t) = r(t) - WO) (1.2.6) 


Introducing this relation into Equation 1.2.5, one gets 


[1 + H,(s) H,(s)] vy) = H>(s) His) ræ (1.2.7) 
from which 
H2(s) Hi(s) 
H _ (1.2.8) 
WT) HS) 


The stability of the closed-loop system will be determined by the real parts of the 
roots (poles) of the transfer function denominator H cz (s). 
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1.2.3 Steady-state Error 


When carrying out the synthesis of a closed-loop system, our aim is to obtain an 
asymptotically stable system having a given response time, a specified overshoot 
and ensuring a zero steady-state error with respect to the reference signal. In Figure 
1.18, it is desired that, in steady-state, y(t) equals r(t), i.e. the steady-state gain of 
the closed-loop system between y(t) and r(t) must be equal to 1. 


r(t) y(t) 


Figure 1.18. Closed-loop system 


In Figure 1.18 the global transfer function of the feedforward channel Ho;(s) is 
of the form 


bo t+byst+..+b,,8"" = B(s) 


Ho,(s)= (1.2.9) 
0 aytast+..ta,s" A(s) 
and the transfer function in closed-loop is given by 
fig! 2 (1.2.10) 


1+Ho,(s)  A(s) + B(s) 


The steady-state corresponds to a zero frequency (s = 0). The steady-state gain is 
obtained by making s = 0 in the transfer function given by Equation 1.2.10. 


= Sc Uy jati 
y=HAe,(0)r A) + BOO)” RENT (1.2.11) 


in which y and r represent the stationary values of the output and the reference. 
To obtain a unitary steady-state gain (Hçcz(0) = 1), it is necessary that 


(1.2.12) 


This implies that the denominator of the transfer function H(s) should be of the 
following form: 


A(s) = s(ays + ays? +...+.a, 48") =8.A"(s) (1.2.13) 
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and, respectively: 


1 B 
Ho,(6)=+- 


(1.2.14) 


Thus to obtain a zero steady-state error in closed-loop when the reference is a step, 
the transfer function of the feedforward channel must contain an integrator. 

This concept can be generalized for the case of time varying references as 
indicated below with the internal model principle: to obtain a zero steady-state 
error, Hozr(s) must contain the internal model of the reference r(f). 

The internal model of the reference is the transfer function of the filter that 
generates r(t) from the Dirac pulse. E.g., step =(l/s)- Dirac, 


ramp = (1/ s°) - Dirac ). For more details see Appendix A. 


Therefore, for a ramp reference, Hoz(s) must contain a double integrator in 
order to obtain a zero steady-state error. 


1.2.4 Rejection of Disturbances 


Figure 1.19 represents the structure of a closed-loop system in the presence of a 
disturbance acting on the controlled output. Hoz(s) is the open-loop global transfer 


function (controller + plant) and is given by Equation 1.2.9. 


p(t) (disturbance) 


+ 
y(t) 


Figure 1.19. Closed-loop system in the presence of disturbances 


Generally, we would prefer that the influence of the disturbance p(f) on the 
system output be as weak as possible, at least in given frequency regions. In 
particular, we would prefer that the influence of a constant disturbance (step 
disturbance), often called “load disturbance”, be zero during in steady-state regime 
(t>0,s—->0). 

The transfer function between the disturbance and the output is written as: 


1 B A(s) 
1+Ho,(s) A(s)+B(s) 


S,,(s) = (1.2.15) 


Syp(s) is called “output sensitivity function”. 
The steady-state regime corresponds to s = 0. 
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z ___ 40) _ 4% 
VY =Syp(O)p 40) + BO)” TA (1.2.16) 


in which y and p represent the steady-state values of the output and respectively of 
the disturbance. 

S\,(0) must be zero for a perfect rejection of the disturbance in steady-state 
regime. It follows (as in Section 1.2.3) that, in order to obtain the desired property, 
we must have ay = 0. This implies the presence of an integrator in the direct path 
in order to have a perfect rejection of a step disturbance during steady-state regime 
(see previous section). 

As a general rule, the direct path must contain the internal model of the 
disturbance in order to obtain a perfect rejection of a deterministic disturbance (see 
previous section). 


Example: Sinusoidal Disturbance of Constant Frequency. 
The internal model of the sinusoid is 1/(1+ s?/ oe ) (the transfer function of the 


filter which, excited by a Dirac pulse, generates a sinusoid). For a perfect rejection 
(asymptotically) of this disturbance the controller must contain the transfer 


function 1/(1+.s*/@@) . 


In general, we also have to check if there is not an amplification of the 
disturbance’s effect in certain frequency regions. That is why we must require that 
the modulus of |S\,(/@)| be inferior to a given value at all frequencies. A typical 
value for this condition is 


| Sy Ga) |<2 (6dB) forall œ (1.2.17) 


We may also require that S,,(j@) introduces a given attenuation in a certain 
frequency range, if we know that a disturbance has its energy concentrated in this 
frequency range. 


1.2.5 Analysis of Closed-loop Systems in the Frequency Domain: Nyquist Plot 
and Stability Criterion 


The transfer function of the open-loop Hoz(s) (Figure 1.19) can be represented in 
the complex plane when ø varies from 0 to cas 


Ho, (jo) =Re Hy, (jo) + j Img, (jo) =|Ho, (jo). 2G) (1.2.18) 


The plot of the transfer function in this plane is graduated in frequencies (rad/s). 
This representation is often called a Nyquist plot (or hodograph). 
Figure 1.20 shows the Nyquist plot for H,(s)=1/(1+s)and 


H(s) =1/[s(1+s)]. Note that the plot of H,(s) corresponds to the typical case 
where an integrator is present in the loop (to ensure a zero steady-state error). 
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Figure 1.20. Nyquist plot for H,(s) =1/(1+s) and H, (s) =1/[s(1+5)] 


These curves show the gain and phase of the transfer function at different 
frequencies. The vector joining the origin to a point on the hodograph of the 
transfer function represents H(j@) for a certain frequency æ. 

In this diagram, the point [-/, j0] plays a particularly important role (critical 
point). We can see in Figure 1.21 that the vector connecting the point [-/, j0] to the 
plot of the open-loop transfer function Hoz (jæ) is given by 


Sp (ja) =1+ Ho, (ja) (1.2.19) 


Im H (ja) 


ReH (jæ) 


M , 
1 + Halo) Ha ljo) 


Figure 1.21. Nyquist plot and the critical point 


This vector corresponds to the inverse of the output sensitivity function (see 
Equation 1.2.15). The denominator of the output sensitivity function defines the 
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poles of the closed-loop transfer function. The stability properties of the system are 
determined by the denominator of the transfer function. In order that the closed- 


loop system be asymptotically stable, all the poles of S,,,(s) must lie in the half- 


plane Res <0. 


If the plot of the open-loop transfer function Hoz(s) passes through the point [- 
1, j0], for a value s = jæ, the denominator of the closed-loop system transfer 
function will be null at this frequency. The closed-loop system will not be 
asymptotically stable (more precisely it will have poles on the imaginary axis). It 
then follows a necessary condition (but not sufficient) for the closed-loop system to 
be asymptotically stable: the hodograph of H(s) must not pass through the point [- 
1, j0]. The Nyquist criterion gives the necessary and sufficient conditions for the 
asymptotic stability of the closed-loop system. 

For systems having open-loop stable poles (Res < 0) the Nyquist stability 
criterion is expressed as: The plot of the open-loop transfer function Hoz (s) 


traversed in the sense of growing frequencies (from œ = 0 to œ = z) must leave the 
critical point [-1, j0] on the left. 

As a general rule, a controller will be computed for the nominal model of the 
plant so that the closed-loop system be asymptotically stable, i.e. Hoz (s) will leave 
the critical point on the left. 

It is also obvious that the minimal distance to the critical point will characterize 
the “stability margin” or “robustness” of the closed-loop system in relation to 
variations of the system parameters (or uncertainties in parameter values). 


1.3 PI and PID Controllers 


The PI (proportional + integral) and PID (proportional + integral + derivative) 
controllers are widely used for the control of continuous-time systems. 

An extremely rich literature has been dedicated to design methods and 
parameters adjustment of these controllers. Also note that there are several 
structures for PI and PID controllers (with different transfer function and tuning 
parameters). 

Synthesis methods for PI and PID controllers have been developed and 
implemented (see the references at the end of the chapter). These methods can be 
divided into two categories: a) methods using frequency and time characteristics of 
the plant (non—parametric model) and b) methods using the plant transfer function 
(parametric model). 

In this section, we shall only present basic schemes for PI and PID controllers 
as an introduction to the digital PI and PID controllers. 


1.3.1 PI Controller 
In general PI controllers have as input the difference between the reference and the 


measured output and as output the control signal delivered to the actuator (see 
Figure 1.15). A typical transfer function of a PI controller is 
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(1.3.1) 


E 1 |_KTs+1) 
HR(s) xli -| 


Tis 


i 


in which K is called the proportional gain and T, the integral action of the PI 


controller. There also exist, however also PI controllers with independent actions, 
ié; 


1 
Hrp(s)=K, +— 


Tis 


In certain situations the proportional action may operate only on the measured 
output. 


1.3.2 PID Controller 


The transfer function of a typical PID controller is 


1 
Hrm) = K| 14 a (1.3.2) 
Tis 1474, 
N 


in which K specifies the proportional gain, T, characterizes the integral action, T} 
characterizes the derivative action and 1 + (T.,/N) s introduces a filtering effect on 


the derivative action (low-pass filter). 
By summing up the three terms, the transfer function given by Equation 1.3.2 
can also be rewritten as 


TiTa 
N 


K tarate) TiTa + 


H pip(s) = 
ri[1+2s] 
N 


(1.3.3) 


Several structures for PID controllers exist. In addition there are situations when 
the proportional and derivative actions act only on the measured output. 
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1.4 Concluding Remarks 


The behavior of controlled plants around an operating point can in general be 
described by linear dynamic models. Linear dynamic models are characterized in 
the time domain by linear differential equations and in the frequency domain by 
transfer functions. 

Control systems are closed-loop systems that contain the plant, the controller 
and the feedback connection. For these systems, the control applied to the plant is a 
function of the difference between the desired value and the measured value of the 
controlled variable. Control systems are characterized by a dynamic model that 
depends upon the structure and the coefficients of the plant and controller transfer 
functions. 

The desired control performances can be expressed in terms of the desired 
characteristics of the dynamic model of the closed-loop system (ex.: transfer 
function with specified coefficients). This allows the synthesis of the controller if 
the plant model is known. 

The plot in the complex plane of the transfer function of the open-loop system 
(controller + plant), also called Nyquist plot, plays an important role in the 
assessment of controller qualities. In particular, it allows studying of the stability 
and robustness properties of the closed-loop system. 


1.5 Notes and References 


Many books deal with the fundamentals of continuous-time control. Among the 
different titles we can mention: 


Takahashi Y., Rabins M., Auslander D. (1970) Control. Addison Wesley, 
Readings, Mass 

Franklin G., Powell J.D. (1986) Feedback Control of Dynamic Systems. Addison 
Wesley, Reading, Mass 

Ogata K. (1990) Modern Control Engineering (second edition). Prentice Hall, N.J 

Kuo B.C. (1991) Automatic Control Systems (sixth edition). Prentice Hall, N.J 


PID controller adjustment techniques are discussed in: 


Ziegler J.G., Nichols N.B. (1942) Optimum Settings for Automatic Controllers. 
Trans. ASME, vol. 64, pp. 759-768 

Shinskey F.G. (1979) Process Control Systems. McGraw-Hill, N.Y. 

Astrém K.J., Hägglund I. (1995) PID Controllers Theory, Design and Tuning, 2nd 
edition. ISA, Research Triangle Park, N.C., U.S.A 

Voda A., Landau I.D. (1995a) A method for the auto-calibration of PID 
controllers. Automatica, vol. 31, no. 1, pp. 45-53. 

Voda A., Landau I.D. (1995b) The auto-calibration of PI controllers based on two 
frequency measurements. Int. J. of Adaptive Control and Signal Processing, 
vol. 9, no. 5, pp. 395-422 

as well as in (Takahashi et al. 1970) and (Ogata 1990). 
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Computer Control Systems 


In this chapter we present the elements and the basic concepts of computer- 
controlled systems. The discretization and choice of sampling frequency will be 
first examined, followed by a study of discrete-time models in the time and 
frequency domains, discrete-time systems in closed loop and basic principles for 
designing digital controllers. 


2.1 Introduction to Computer Control 


The first approach for introducing a digital computer or a microprocessor into a 
control loop is indicated in Figure 2.1. The measured error between the reference 
and the output of the plant is converted into digital form by an analog-to-digital 
converter (ADC), at sampling instants k defined by the synchronization clock. The 
computer interprets the converted signal y(k) as a sequence of numbers, which it 
processes using a control algorithm and generates a new sequence of numbers 
{u(k)} representing the control. By means of a digital-to-analog converter (DAC), 
this sequence is converted into an analog signal, which is maintained constant 
between the sampling instants by a zero-order hold (ZOH). The cascade: ADC- 
computer-DAC should behave in the same way as an analog controller (PID type), 
which implies the use of a high sampling frequency but the algorithm implemented 
on the computer is very simple (we just do not make use of the potentialities of the 
digital computer!). 

A second and much more interesting approach for the introduction of a digital 
computer or microprocessor in a control loop is illustrated in Figure 2.2 which can 
be obtained from Figure 2.1 by moving the reference-output comparator after the 
analog-to-digital converter. The reference is now specified in a digital way as a 
sequence provided by a computer. 

In Figure 2.2 the set DAC - plant - ADC is interpreted as a discretized system, 
whose control input is the sequence {u(k)} generated by the computer, the output 
being the sequence {y(k)} resulting from the A/D conversion of the system output 
y(t). This discretized system is characterized by a “discrete-time model”, which 
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describes the relation between the sequence of numbers {u(k)} and the sequence of 
numbers {y(k)}. This model is related to the continuous-time model of the plant. 


CONTROLLER 


Figure 2.1. Digital realization of an « analog » type controller 


COMPUTER 


DISCRETIZED PLANT 


Figure 2.2. Digital control system 


This approach offers several advantages. Among these advantages here we 
recall the following: 


1. The sampling frequency is chosen in accordance with the “bandwidth” of 
the continuous-time system (it will be much lower than for the first 
approach). 
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2. Possibility of a direct design of the control algorithms tailored to the 
discretized plant models. 

3. Efficient use of the computer since the increase of the sampling period 
permits the computation power to be used in order to implement 
algorithms which are more performant but more complex than a PID 
controller, and which require a longer computation time. 


In fact, if one really wants to take advantage of the use of a digital computer in 
a control loop, the “language” must also be changed. This may be achieved by 
replacing the continuous-time system models by discrete-time system models, the 
continuous-time controllers by digital control algorithms, and by using dedicated 
control design techniques. 


The changing over to this new “language” (discrete-time dynamic models) 
makes it possible to use various high performing control strategies which cannot be 
implemented by analog controllers. 

The operating details of the ADC (analog-to-digital converter), the DAC 
(digital-to-analog converter) and the ZOH (zero-order hold) are illustrated in 
Figure 2.3. 


A.D.C. 


sampling period 


Figure 2.3. Operation of the analog-to-digital converter (ADC), the digital-to-analog 
converter (DAC) and the zero-order hold (ZOH) 
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The analog-to-digital converter implements two functions: 

1. Analog signal sampling: this operation consists in the replacement of 
the continuous signal with a sequence of values equally spaced in the 
time domain (the temporal distance between two values is the 
sampling period), as these values correspond to the continuous signal 
amplitude at sampling instants. 

2. Quantization: this is the operation by means of which the amplitude of 
a signal is represented with a discrete set of different values (quantized 
values of the signal), generally coded with a binary sequence. 

The general use of high-resolution A/D converters (where the samples are 
coded with 12 bits or more) allows one to consider the quantification effects as 
negligible, and this assumption will hold in the following. Quantization effects will 
be taken into account in Chapter 8. 

The digital-analog converter (DAC) converts at the sampling instants a discrete 
signal, digitally coded, in a continuous signal. 

The zero-order hold (ZOH) keeps constant this continuous signal between two 
sampling instants (sampling period), in order to provide a continuous-time signal. 


2.2 Discretization and Overview of Sampled-data Systems 


2.2.1 Discretization and Choice of Sampling Frequency 


Figure 2.4 illustrates the discretization of a sinusoid of frequency fọ for several 
sampling frequencies f,. 
It can be noted that, for a sampling frequency f, = 8 fọ, the continuous nature of 


the analog signal is unaltered in the sampled signal. 
For the sampling frequency f, = 2 fọ, if the sampling is carried out at instants 


2afo t other than multiples of z, a periodic sampled signal is still obtained. 
However if the sampling is carried out at the instants where 27f, t = na, the 


corresponding sampled sequence is identically zero. 
If the sampling frequency is decreased under the limit of f, = 2fọ, a periodic 


sampled signal still appears, but its frequency differs from that of the continuous 
signal (f= f, - fp). 

In order to reconstruct a continuous signal from the sampled sequence, the 
sampling frequency must verify the condition (Nyquist's theorem): 


ty > 2fmax (2.2.1) 
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f =8f 
S 
|| 
f,=2f, 
f =2f 


Figure 2.4. Sinusoidal signal discretization 
in which f pax 
is a theoretical limit; in practice, a higher sampling frequency must be chosen. 

The existence of a maximum limit for the frequency that may be converted 
without distortion, for a given sampling frequency, is also understandable when it 
is observed that the sampling of a continuous-time signal is a “magnitude 
modulation” of a “carrier” frequency f, (analogy with the magnitude modulation in 


is the maximum frequency to be transmitted. The frequency f,=2 f nax 


radio transmitters). The modulation effect may be observed in the replication of the 
spectrum of the modulating signal (in our case the continuous signal) around the 
sampling frequency and its multiples. 

The spectrum of the sampled signal, if the maximum frequency of the 
continuous signal (f,,,,) is less than (//2) f,, is represented in the upper part of 
Figure 2.5. 

The spectrum of the sampled signal, iff. > (J/2)f,, 1s represented in the lower 
part of Figure 2.5. The phenomenon of overlapping (aliasing) can be observed. 
This corresponds to the appearance of distortions. The frequency (//2)f,, which 


defines the maximum frequency (fax) admitted for a sampling with no distortions, 


) 
NAX: 
is known as “Nyquist frequency” (or Shannon frequency). 
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Case 1:f PAL f 


max 2 S 
° f f 2f 3f 


max s s s 
Continuous-time Spectrum of the 
spectrum sampled signal 


Case 2 : f s f 


N l | A 

o ff f 7 2f 3 f 
max S S S 

Continuous-time Overlapping (aliasing) 

spectrum of the spectrum (distorsions !) 


Figure 2.5. Spectrum of a sampled signal 


For a given sampling frequency, in order to avoid the folding (aliasing) of the 
spectrum and thus of the distortions, the analog signals must be filtered prior to 
sampling to ensure that: 


1 
2.2.2 
J max” 2 T ( ) 


The filters used are known as “anti-aliasing filters”. A good anti-aliasing filter 
must have a minimum of two cascaded second-order cells (f,,,,. << (1/2) f). An 
example of an anti-aliasing filter of this type is given in Figure 2.6. These filters 
must introduce a large attenuation at frequencies higher than (//2) f, but their 
bandwidth must be higher than the required bandwidth of the closed loop system 
(generally higher than open loop system bandwidth). Circuits of this type (or more 
complex) are currently available. 


2 
D O; 
| 3 2 a 2 2> 
OQ) + 20,65 +58 @ + 20,68 +s 


Figure 2.6. Anti-aliasing filter 


Computer Control Systems 31 


In the case of very low frequency sampling, first a sampling at a higher 
frequency is carried out (integer multiple of the desired frequency), using an 
appropriate analog anti-aliasing filter. The sampled signal thus obtained is passed 
through a digital anti-aliasing filter followed by a frequency divider (decimation) 
thereby giving a sampled signal having the required frequency. This procedure is 
shown in Figure 2.7. It is also employed every time the frequency of data 
acquisition is higher than the sampling frequency chosen for the loop that must be 
controlled (the sampling frequency should be an integer divider of the acquisition 
frequency). 


y(t) 


Anti-aliasing y (k) 
digital filter 


Anti-aliasing 
analog filter 


A/D converter Under-sampling 
(acquisition frequency) (Ts =n.Ta) 


Figure 2.7. Anti-aliasing filtering with under-sampling 


2.2.2 Choice of the Sampling Frequency for Control Systems 


The sampling frequency for digital control systems is chosen according to the 
desired bandwidth of the closed loop system . Note that, no matter how the desired 
performances are specified, these can always be related to the closed loop system 
bandwidth. 

Example: Let us consider the performances imposed in Section 1.1.6 on the 
step response (maximum overshoot 5%, rise time 2.75 s). The transfer function to 
be determined corresponds to the desired closed loop system transfer function. 
From the diagrams given in Figure 1.11 we have deduced that the closed loop 
transfer function must be a normalized second-order transfer function with ¢=0.7 
and @)=1 rad/s. By immediately using the diagrams given in Figure 1.12, it can be 


observed that the bandwidth of the closed loop system is approximately equal to 


a_ l 
=— Hz 
DoF 


The rule used to choose the sampling frequency in control systems is the 
following: 


f =(6t025) fF (2.2.3) 


where 


f,: sampling frequency, f A : closed loop system bandwidth 
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Rule of Equation 2.2.3 is equally used in open loop, when it is desired to 
choose the sampling frequency in order to identify the discrete-time model of a 


plant. In this case f, i is replaced by an estimation of the bandwidth of the plant. 
For information purposes, Table 2.1 gives the sampling periods (T, = J/f,) used 


for the digital control of different types of plants. 
The rule for choosing the sampling frequency given in Equation 2.2.3 can be 
connected to the transfer function parameters. 


First- order system 


1 
1+ sTp 


H(s)= 


In this case the system bandwidth is 


1 


Se= oT, 


(an attenuation greater than 3 db is introduced for frequencies higher than @) = 


Table 2.1. Choice of the sampling period for digital control systems (indicative values) 


Type of variable Sampling period (s) 


(or plant)) 


_ 
J- 
10 


Computer Control Systems 33 


By applying the rule of Equation 2.2.3 the condition for choosing the sampling 
period is obtained (T, = 1/f,): 


T, 
ee 27 (2.2.4) 
4 $ 
This corresponds to the existence of two to nine samples on the rise time of a step 
response. 


Second- order system 


2 
M0 


2 2 
ao+26 a@osts 


H(s)= 


The bandwidth of the second-order system depends on @p, and on ¢ (see Figure 


1.12). 
For example: 


=0.7> f,=— 
4 Jasos 


0.6 0 


E 27 


By applying the rule of Equation 2.2.3, the following relations are obtained 
between the natural frequency @, and the sampling period T, : 


0.25 < @T,< 1; C=0.7 (2.2.5) 
and 
0.4 < œT, < 1.75; C=] (2.2.6) 


The lower values correspond to the choice of a high sampling frequency and 
the upper values to the choice of a low sampling frequency. 

For simplicity's sake, given that in closed loop the behavior frequently chosen 
as the desired behavior is that of a second order having a damping factor 
¢ between 0.7 and 1, the following rule can be used (approximation of Equations 
2.2.5 and 2.2.6): 


0.25 < T, 21s ; OF 2e SI (2.2.7) 
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2.3 Discrete-time Models 


2.3.1 Time Domain 


Figure 2.8 illustrates the response of a continuous-time system to a step input, a 
response that can be simulated by a first order system (an integrator with a 
feedback gain indicated in the figure). 


dy 


u dt 


Figure 2.8. Continuous-time model 
The corresponding model is described by the differential equation 


dy 
dt 


1 G 

=—— y(t) + —u(t) (2.3.1) 
T T 

or by the transfer function 


H(s)= 


(2.3.2) 
1l+sT 


where T is the time constant of the system and G is the gain. 

If the input u(t) and the output (4) are sampled with a specified sampling 
period, the representations of u(t) and y(t) are obtained as number sequences in 
which ¢ (or k) is now the normalized discrete-time (real time divided by the 
sampling period, £ = t/T,). The relation between the input sequence {u(f)} and the 
output sequence {y(f)} can be simulated by the scheme given in Figure 2.9 by 
using a delay (backward shift) operator (symbolized by qt: \(t-1) = q! y), 
instead of an integrator. 

This relation is described in the time domain by the algorithm (known as 
recursive equation or difference equation) 


y(t) = -a, y(t-1) + b; u(t-1) (2:3:3) 
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u(t-1) 


sanilii 
i | 
: | 
t delay t 
q1 


Figure 2.9. Discrete-time model 


Let us now examine in greater detail the discrete-time model given by Equation 
2.3.3 for a zero initial condition (y(0) = 0) and a discrete-time unit step input: 


i t<0 
u(t) = i 


t20 


The response is directly computed by recursively using Equation 2.3.3 from t= 0 
(in the case of discrete-time models there are no problem with the integration of the 
differential equations like in continuous time). We shall examine two cases. 


Case 1. aj=-0.5 ; b]=0.5 
The output values for different instants are given in Table 2.2 and the 
corresponding sequence is represented in Figure 2.10. 


Table 2.2. Step response of a first-order discrete-time model (a4= -0.5, b4= 0.5) 


p> fol stats fads | 


12 3 4 5 6 t 


Figure 2.10. Step response of a first-order discrete- time model (a; = -0.5, b4= 0.5) 


It is observed that the response obtained resembles the step response of a 
continuous-time first order system which has been sampled. An equivalent time 
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constant for the continuous-time system can even be determined (rise time from 0 
to 90 %: tp = 2.2 T). From Table 2.2, one then obtains 


3 S AT, 
22 2.2 
Case 2. ap,=05 ; bp =L5 


Output values for different instants are given in Table 2.3 and the corresponding 
sequence is represented in Figure 2.11. 


Table 2.3. Step response of a first-order discrete-time model (a;=0.5; b,=1.5) 


An oscillatory damped response is observed with a period equal to two sampling 
periods. This type of phenomenon cannot result from the discretization of a 
continuous-time first order system, since this latter is always a-periodic. It may 
thus be concluded that the first order discrete-time model corresponds to the 
discretization of a first order continuous-time system only if a, is negative’. 


hy 
1,5- ° 
1 p 
0,5 Damped 
oscillating 
response 
| z 
1 2 3 4 5 6 t 


Figure 2.11. Step response of a first-order discrete-time model (a,;=0.5; b;=1.5) 


We now go back to the method used to describe discrete-time models. The 
delay operator g/ is used to obtain a more compact writing of the recursive 
(difference) equations which describe discrete-time models in the time domain (it 
has the same function as the operator p = d/dt for continuous-time systems). The 
following relations hold: 


' For a positive a, , this corresponds to the discretization of a 2"™ order system, with a damped resonant 


frequency equal to 0.5f, (see Section 2.3.2). 
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-1 
q y(t)=y(t-1) 
q“y(t) = yt -d) na 


By using the operator q! , Equation 2.3.3 is rewritten as 

(I +a; g) y(t) =b; q! ult) (2.3.5) 
Discrete-time models may also be obtained by the discretization of the differential 
equations describing continuous-time models. This operation is used for the 


simulation of continuous-time models on a digital computer. 
Let us consider Equation 2.3.1 and approximate the derivative by 


dy _ y(t+Ts)— y() 


2.3.6 
dt Ts 
Equation 2.3.1 will be rewritten as 
t —y(t) 1 G 
WEST) rO TO= Zuo (2.3.7) 


By multiplying both sides of Equation 2.3.7 by T, and with the introduction of the 


normalized time ¢ (= ¢/T,), it follows that 


y(t +1) (B- po 7 rut) (2.3.8) 


which can be further rewritten as: 
(I +a,q") yt+1) =b; ult) (2.3.9) 


where 
T G 
a =—-1 (<0); b)=—T; 
157 (<0) by pe 


Shifting Equation 2.3.9 by one step, Equation 2.3.3 is obtained. 

We point out that, in order to represent a first-order continuous model with 
Equation 2.3.9, the condition a; < 0 must be verified. As a consequence, the 
sampling period T, must be smaller than time constant T (T, < T). This result 
corresponds to the upper bound in Equation 2.2.4, introduced for sampling period 
selection of a first-order system as a function of the desired closed loop bandwidth. 
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If Equation 2.3.6 is the approximation of the “derivative”, the digital integrator 
equation can be directly deduced. Thus, if normalized time is used, Equation 2.3.6 
is written as 


L y= pyx yO- vt ==") (2.3.10) 


where (/ - q”) is now equivalent to p. As the integration is the opposite of the 
differentiation, one obtains: 


s(t) = | yar = > sa l = vit) (2.3.11) 
-=q 


Multiplying both sides of Equation 2.3.11 by (1-q7%), it follows that 


sU -TH =) (2.3.12) 


which we can rewrite as 


s(t) = s(t-1) + 1. y(t) (2.3.13) 


corresponding to the approximation of the integration operation by means of the 
rectangular rule, as illustrated in Figure 2.12 (if continuous-time is used, Equation 
2.3.13 is written as s(t) = s(t-T,) + T,.v(). 


Figure 2.12. Numerical integration 


2.3.2 Frequency Domain 


The study of continuous-time models in the frequency domain has been carried out 
considering a periodic input of the complex exponential type 


eJO = cos wt +j sin at 


ore’ with s = o + jæ. 
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For the study of discrete-time models in the frequency domain we shall 
consider complex (sampled) exponentials, i.e. sequences resulting from complex 
continuous-time exponentials evaluated at the sampling instants t = k T. 


These sequences will thus be written as 
joT,k sT,k 
eee eS KAT 2S 


Since the discrete-time models being considered are linear, if a signal of a certain 
frequency is applied to the input, a signal of the same frequency, but amplified or 
attenuated according to the frequency, will be found at the output. This is 
summarized in Figure 2.13. in which H(s) is the “transfer function” of the system 
that expresses the dependence of the gain and the phase-deviation on the complex 
frequency s (s =0 + jæ). 


u(t)=e°"™* y(t)=Hljo)e 


DISCRETE TIME 


u(t)=e51* SYSTEM y(t)=H(s)e*'* 


Figure 2.13. Frequency response of a discrete-time system 


T, 


If the input of the system is in the form e° sk , the output will be 


y(t) = H(s)e™" (2.3.14) 
and respectively 
y(t- = H(s)e 4 =e (se =e" y(t) (2.3.15) 
It is thus observed that shifting backward by one step is equivalent to multiplying 
by ets 
Let now determine the transfer function related to the recursive Equation 2.3.3. 


In this case u(t) = e* and the output will be in the form of Equation 2.3.14. By 
also using Equation 2.3.15 one obtains: 


(lt aye" )H(s)e™ =be er (2.3.16) 


from which results 
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-sTs 
Ho. (2.3.17) 
I+ae*™ 
We consider now the following change of variable: 
z=e" (2.3.18) 


which corresponds to the transformation of the left half-plane of the s-plane into 
the interior of the unit circle centered at the origin in the z- plane, as illustrated by 
Figure 2.14. 


Res <0j o Res>0O 


-2 Wy 


T, 


Figure 2.14. Effect of the transformation z = e i 


With the transformation given by Equation 2.3.18 the transfer function given in 
Equation 2.3.17 becomes 


-1 
Beede (2.3.19) 
1 + Qa gl 


Note that the transfer function in z/ can be directly obtained from the recursive 
Equation 2.3.3 by using the delay operator q7 (see Equation 2.3.5), and afterwards 
by formally computing the ratio y(¢)/u(t) and replacing q`? with z/. This procedure 
can obviously be applied to all models described by linear difference equations 
with constant coefficients, regardless of their complexity. The same result can be 
also derived by means of the z - transform (see Appendix A, Section A.2) 

We also remark that the transfer functions of discrete-time models are often 
written in terms of q`. It is of course understood that the meaning of q`? varies 
according to the context (delay operator or complex variable). When q`? is 
considered as a delay operator, the expression H(q~) is named “transfer operator”. 
It must be observed that the representation by transfer operators can also be used 
for models described by linear difference equations with time varying coefficients 
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as well. In contrast, the interpretation of q7 as a complex variable (z“) is only 
possible for linear difference equations with constant coefficients. 
ST, 


s 


Properties of the Transformation Z = € 
The transformation of Equation 2.3.18 is not bijective because several points in the 
s- plane are transformed at the same point in the z-plane. Nevertheless, we are 
interested in the s-plane being delimited between the two horizontal lines crossing 
the points [0,+ j@,/2] and [0,- jæ, /2] where a, = 27f, = 27/T,. This region is 
called “primary strip”. 


Re s <0 j@Res>0 


: sT, f : : 
Figure 2.15. Effects of the transformation z = e “s on the points located in the “primary 
strip” in s-plane 


The complementary bands are outside the frequency domain of interest if the 


conditions of the Shannon theorem (Section 2.2.1) have been satisfied. 


Figure 2.15 gives a detailed image of the effects of the transformation Z = e*” for 
the points that are inside the “primary strip”. 

Attention must be focused on an important aspect for continuous second-order 
systems in the form: 


2 


a (C<1) 


2 2 
aot 2o wos +s 


for which the resonant damped frequency is equal to half the sampling frequency: 
@yl- ° =a@,/2 


The image of their conjugates poles 


. Os 
S1,2 =- @tij 3 
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through the transformation z =e corresponds to a single point placed on the 
real axis in the z- plane and with negative abscissa. 
One gets: 


+È, 


T, =e S0ls 2° esi, 


= plo? s . 
Z2 =e e 


since: 


pen Os 
= H-E? 


This is the reason why discrete-time models in the form of Equation 2.3.3 such as 
I+aq) y)=b gq! ul) 


give oscillating step responses for a; > 0 (damped if |a;| < /) with period 2T, (see 
Section 2.3.1). These first-order discrete-time models have the same poles as the 
discrete-time models derived from second-order continuous-time systems having a 
damped resonant frequency equal to @, /2. 


2.3.3 General Forms of Linear Discrete-time Models 
A linear discrete-time model is generally described as 


ny ng 


yA =- ave-)+ > biut-d-i) (2.3.20) 


i=l i=l 


in which d corresponds to a pure time delay which is an integer multiple of the 
sampling period. 
Let us introduce the following notations: 


ny ; a 
1+) aq” = Alq!) =1+q 4 (q) (2.3.21) 
i=l 


A(q') =a,+ ag +...4 apq” (2.3.22) 


ng 


X biq” =B@ )=4 Bq") (2.3.23) 
i=l 
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B’(q"')=b, +baq™ +.. +b, qg" 2324) 


By using the delay operator g/ in Equation 2.3.20 and taking into account the 
notations of Equations 2.3.21 to 2.3.24, the Equation 2.3.20 describing the discrete- 
time system is written as 


Ag) YO = 4 B) wt (2.3.25) 


or in the predictive form (by multiplying both sides by q% 


ACTI) y(t+d) = Beg!) u(t) (2.3.26) 


Equation 2.3.25 can also be written in a compact form using the pulse transfer 
operator 


y(t) = Mq’) u(t) (2.3.27) 


where the pulse transfer operator is given by 


“BÀ 


Han eU 2.3.28 
H(q )= D ( ) 


The pulse transfer function characterizing the system described by Equation 2.3.20 
is obtained from the pulse transfer operator given in Equation 2.3.28 by replacing 
gq! with z? ? 


Pm Biz!) 


-l_ 
ene” Fey 


(2.3.29) 


Pulse Transfer Function Order 

To evaluate the order of a discrete time model represented by the pulse transfer 
function in the form of Equation 2.3.29, the representation in terms of positive 
power of z is needed. If d is the system pure time delay expressed as number of 
samples, n4 the degree of the polynomial A(z/) and ng the degree of the 
polynomial B(z~/), one must multiply both numerator and denominator of H(z~/) by 
z” in order to obtain a proper? pulse transfer function H(z) on the positive powers 
of z, where 


2 The pulse transfer operator Hg! ) can be used for a compact representation of the input-output 
relationship even in the case of Aq?! ) and Bq! ) have time depending coefficients. The pulse transfer 


function Ae ) is only defined for the case of Ag? ) and Bq ) are with constant coefficients. 
3 This means that the denominator degree is greater than (or equal to) the numerator degree. 
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n= max (n4, ng + d) 


n represents the discrete-time system order (the higher power of a term in z in the 
pulse transfer function denominator). 


Example 1: 
3 -1 p, 2 
H(eh=2 (biz bz ) 
1+ az 
n = max (1, 5) =5 
bız +b 
HO a A 
zZt+az 
Example 2: 
-1 4 p, 2 
HG)= biz +b2z 


It+aqz't+az? 


n = max (2, 2) =2 


ZF 
A®= A b2 
ztazt+a2 
One notes that the order n of an irreducible pulse transfer function also corresponds 
to the number of states for a minimal state space system representation associated 
to the transfer function (See Appendix C). 


2.3.4 Stability of Discrete-time Systems 

The stability of discrete-time systems can be studied either from the recursive 
(differences) equation describing the discrete-time system in the time domain, or 
from the interpretation of difference equations solutions as sums of discretized 


exponentials. We shall use examples to illustrate both these approaches. 
Let us assume that the recursive equation is 


vy) =-a;y(t-l) ; yO=y (2.3.30) 


which is obtained from Equation 2.3.3 when the input u(f) is identically zero. The 
free response of the system is written as 


WL) = -a;¥9 > VO) = (ay? yo ; VD = Ca) Vo (2.3.31) 
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The asymptotic stability of the system implies 


lim y(t) = 0 (2.3.32) 
t>o0 


The condition of asymptotic stability thus results from Equation 2.3.31. It is 
necessary and sufficient that 


laj|< 1 (2.3.33) 


On the other hand, it is known that the solution of the recursive (difference) 
equations is of the form (for a first-order system): 


y(t) = K eT” = Kz" (2.3.34) 


By introducing this solution into Equation 2.3.30, and taking into account Equation 
2.3.15, one obtains 


(1+ aje*" )Ke™ =(14.a,z7')Kz' =0 (2.3.35) 
from which it follows that 


STs _ plotja)l, _ 9% fol, _ -a (2.3.36) 


z=e 
For this solution to be asymptotically stable, it is necessary that o = Re s < 0 which 
implies that e°fs < J and respectively |z| < J (or |a;| < 1), 

However, the term (Z + a, z”) is nothing more than the denominator of the 
pulse transfer function related to the system described by Equation 2.3.3 (see 
Equation 2.3.19). 

The result obtained can be generalized. For a discrete-time system to be 


asymptotically stable, all the roots of the transfer function denominator must be 
inside the unit circle (see Figure 2.14): 


on taz” =0 => || <1 (2.3.37) 


In contrast, if one or several roots of the transfer function denominator are in the 
region defined by |z| > / (outside the unit circle), this implies that Re s > 0 and 
thus the discrete-time system will be unstable. 

As for the continuous-time case, some stability criteria are available (Jury 
criterion, Routh-Hurwitz criterion applied after the change of variable 
w = (z + /)Xz-1)) for establishing the existence of unstable roots for a polynomial 
in the variable z with no explicit calculation of the roots (Astrém and Wittenmark 
1997). 
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A helpful tool to test z-polynomial stability is derived from a necessary 
condition for the stability of a z/-polynomial. This condition states: the evaluations 
of the polynomial A(z’) given by Equation 2.3.37 in z = 1, (A(/)) and in z = -1 
(A(-1)) must be positive (the coefficient of A(q~/) corresponding to z’ is supposed 
to be positive). 


Example: 
A(z!) =1-0.5z! (stable system) 


A) =1-0.5=0.5>0 ; ACD =14+05=15>0 


A(z!) =1-1.5z!; (unstable system) 


A(1)=-0.5<0 ; A(-1)=2.5>0 


2.3.5 Steady-state Gain 


In the case of continuous-time systems, the steady-state gain is obtained by making 
s = 0 (zero frequency) in the transfer function. In the discrete case, s = 0 
corresponds to 


s=0>z=e" =1 (2.3.38) 


and thus the steady-state gain G(0) is obtained by making z = / in the pulse 
transfer function. Therefore for the first-order system one obtains: 


-1 
G(0) = biz bi 
l+a, 


l+az 


1 


z=l 


Generally speaking, the steady-state gain is given by the formula 


z 4 B(z") 
A(z") 


= (2.3.39) 


zal 1+ oa 


G(0) = H(1) = H(z") a= 


In other words, the steady-state gain is obtained as the ratio between the sum of the 
numerator coefficients and the sum of the denominator coefficients. This formula 
is quite different from the continuous-time systems, where the steady-state gain 
appears as a common factor of the numerator (if the denominator begins with 1). 
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The steady-state gain may also be obtained from the recursive equation 
describing the discrete-time models, the steady-state being characterized by u(t) = 
const. and y(t) = y(t-1) = y(t-2).... 

From Equation 2.3.3, it follows that 


(I +a) yy) =b; uy) 
and respectively 


by 
l+a 


y(t) = ult) = Gut) 


2.3.6 Models for Sampled-data Systems with Hold 


Up to this point we have been concerned with sampled-data systems models 
corresponding to the discretization of inputs and outputs of a continuous-time 
system. However, in a computer controlled system, the control applied to the plant 
is not continuous. It is constant between the sampling instants (effect of the zero- 
order hold) and varies discontinuously at the sampling instants, as is illustrated in 
Figure 2.16. 

It is important to be able to relate the model of the discretized system, which 
gives the relation between the control sequence (produced by the digital controller) 
and the output sequence (obtained after the analog-to-digital converter), to the 
transfer function H(s) of the continuous-time system. The zero-order hold, whose 
operation is reviewed in Figure 2.17 introduces a transfer function in cascade with 
H(s). 


DAC a 
+ 


, | ZOH 


Figure 2.16. Control system using an analog-to-digital converter followed by 
a zero-order hold 


1(t 
ZERO 2 
—| ORDER M> 
HOLD — 
iT. + 
<_> 
T 


1T.) 


Figure 2.17. Operation of the zero-order hold 
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The hold converts a Dirac pulse given by the digital-to-analog converter at the 
sampling instant into a rectangular pulse of duration 7,, which can be interpreted as 


the difference between a step and the same step shifted by 7,. As the step is the 
integral of the Dirac pulse, it follows that the zero-order hold transfer function is 


H yoy (8) = (2.3.40) 


Equation 2.3.40 allows one to consider the zero-order hold as a filter having a 
frequency response given by 


1-e i sin(@T, /2) -io™ 
H yoy(j@) = =T, 2 
zou(J®) jo of /2 


From the study of this response in the frequency region 0<f< f /2 
(0<@<q@,/2), one can conclude: 
1. The ZOH gain at the zero frequency is equal to: Gzgy(0) = Ts. 


2. The ZOH introduces an attenuation at high frequencies. For f = fs / 2 one 
2 
gets G(f,/2) = — T, = 0.637 T, (-3. 92 dB). 
1 


3. The ZOH introduces a phase lag which grows with the frequency. This 
phase lag is between 0 (for f = 0) and - 2/2 (for f = fẹ / 2) and should be 


added to the phase lag due to A(s). 
The global continuous-time transfer function will be 


l- eT 


H'(s)= H(s) (2.3.41) 


to which a pulse transfer function is associated. 

Tables which give the discrete-time equivalent of systems with a zero-order 
hold are available. Some typical situations are summarized in Table 2.4. 

The computation of ZOH sampled models for transfer functions of different 
orders can be done by means of the functions: cont2disc.sci (Scilab) or cont2disc.m 
(MATLAB"). The corresponding sampled model (with Z.O.H) for a second-order 


system characterized by w,and ¢ can be obtained with the functions ft2pol.sci 
(Scilab) or fi2pol.m (MATLAB*)‘. 


4 To be downloaded from the book website. 
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2.3.7 Analysis of First-order Systems with Time Delay 


The continuous-time model is characterized by the transfer function 


G e** 


H(s)= 
1+T, 


(2.3.42) 


where G is the gain, T is the time constant and ris the pure time delay. If T, is the 


sampling period, then 7 is expressed as 
t=dT, +L; O<L<T, (2.3.43) 


where L is the fractional time delay and d is the integer number of sampling 
periods included in the delay and corresponding to a sampled delay of d-periods. 
From Table 2.4, one derives the transfer function of the corresponding sampled 
model (when a zero-order hold is used) 


oz bz +b?) 24 +bz!) 


=l 
H(z ) TE = 
az l+ajz 


(2.3.44) 


with 


T, L-T, T, L 


s s 


asee la hebi T Iz bece Te? i 


The effect of the fractional time delay can be seen in the appearance of the 
coefficient b, in the transfer function. For L = 0, one gets b) = 0. On the other 
hand, if L = T, it follows that b; = 0, which correspond to an additional delay of 
one sampling period. For L<0.5T, one has b, < by and for L>0.5T, one has 
b,> b;. For L=0.5T, b) = b;. Therefore, a fractional delay introduces a zero in the 
pulse transfer function. For L > 0.5 T, the relation |b,| > |b,| holds and the zero is 


outside the unit circle (unstable zero). 

The pole-zero configuration in the z plane for the first-order system with ZOH 
is represented in Figure 2.18. The term z@/ introduces d+J poles at the origin 
[A(z) = (byz + b2) /z%*! (z + a)]. 


> The presence of unstable zeros has no influence on the system stability, but it imposes constraints on 
the use of controller design techniques based on the cancellation of model zeros by controller poles. 


50 Digital Control Systems 


Table 2.4. Pulse transfer functions for continuous-time systems with zero-order hold 


H(s) H(z") 
1 Tz! 
AY 1-2 
G bz! 

i _ eae -T,/T 
l+sT Tract Dele ) ; Gare 
—sL 
$ b +b = 

Ge £20. 1 t7 = Gia): 
1+sT : lige” 

by = Ge T (elt -l); a, =e 5T 

oe bz! + baz? 


1+ az! + az 


b=1 of p+ $20 o); b, =a? af Eo- p) 
oO @O 


aq =-2afß ; a= a’ 


a= ; B=cos(oT,); 6 =sin(@T,) 


Figure 2.19 represents the step responses for a system characterized by a pulse 


transfer function 


- biz” 
H(z j= _ z] 
l+az 


with 


+a 


a,=-0.2; -0.3 ; -0.4; -0.5 ; -0.6; -0.7 ; -0.8 ; -0.9 


(2.3.45) 


bi = 1 (steady-state gain = 1) for different values of the parameter a;: 
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Figure 2.18. Pole-zero configuration of the sampled-data system described by Equation 
2.3.44 ( first order system with ZOH) 


On the basis of these responses, it is easy to derive the time constant of the 
corresponding continuous-time system, expressed in terms of the sampling period 
(the time constant is equal to the time required to reach 63% of the final value). 

The presence of a time delay equal to an integer multiple of the sampling 
period only causes a time shift in the responses given in Figure 2.19. 


Step Responses 


Time (tT) 


Figure 2.19. Step responses of the discrete-time system b; z"'/(1+a, z”) for different values 
of a, and [b, /(1+ a,) J=1 


The presence of a fractional time delay has as a main consequence a 
modification at the beginning of the step response, if compared to the case with no 


fractional time delay. 


Exercise. Assuming that the sampled-data system model is 
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y(t) = - 0.6 y(t-1) + 0.2 u(t-1) + 0.2 u(t-2) 


What is the corresponding continuous-time model? 
It is interesting to analyze the relation between the location of the pole 
(z =~—a,) and the rising time of the system. Figure 2.19 indicates that the response 


of the system becomes slower as the pole of the system moves toward the point [1, 
j0], and it becomes faster as the pole of the system approaches the origin (z = 0). 
These considerations can be applied to systems with several poles. 

In the case of systems with more than one pole, the term “dominant pole(s)” is 
introduced to characterize the pole (or the poles) that is (are) the closest to the 
point [7,70], i.e. which is the slowest pole(s). 

Figure 2.20 shows the frequency responses (magnitude and phase) of the first- 
order discrete system given by 2.3.45 for az = - 0.8; -0.5; -0.3. It can be observed 
that the bandwidth increases when the system pole is approaching the origin (faster 
pole). We can also remark that the phase lag at the frequency 0.5f, is -180° due to 


the presence of the ZOH (see Section 2.3.6). 


Bode Diagrams 


Magnitude (dB) 


Phase (deg) 


i i 
0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 
Frequency (f/f ) 


Figure 2.20. Frequency responses (magnitude and phase) of the discrete-time model b, z~! / 
(1 +a, z-!) for different values of ay and by 


2.3.8 Analysis of Second-order Systems 


The pulse transfer function corresponding to the discretization with a zero-order 
hold of a normalized second-order continuous-time system, characterized by a 
natural frequency wp and a damping ¢, is given by 
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z! (bz) +b”) 
2 


H(z")= (2.3.46) 


l+ajz! +a, z 


where d represents the integer number of sampling periods contained in the delay. 
The values of a), a>, b}, b as a function of @p and ¢ for a pure time delay T= dT, 


are given in Table 2.4. 

It is interesting to express the poles of the discretized system as a function of 
@, and the sampling period T, (or the sampling frequency fy). 

From Table 2.4 the following relations are easily found (for ¢< 1): 


- í 2 - ( dow!-2?T, 4. -jolt 
a=—e STs COS Eg 1-¢ T,=-e Sols (ojoo s Tst e Jon \-¢ Ts) 

-2 
a2=-e Cos 


The poles of the pulse transfer function (roots of the denominator) are found by 
solving the equation 


z? +aj)z+ ay = (z-2)) C-z) =0 


From the expressions of a; and a, the solutions are directly derived: 


— Sal, tia 1-677, 
Z2 75e 


Note that the poles of the discretized system correspond to the poles of the 


continuous-time system si> = @otjæoyl-¢ by applying the transformation 
T, 


s 


z= e° 

For ¢ < /, the poles of the discretized system are complex conjugate and, 
consequently, symmetric with respect to the real axis. They are characterized by a 
module and a phase given by 


Zz =ty1—C? wT, =420y1-C? h =i ag? 2 
Š (a) 


S 
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Pole - Zero Map 


0 
Real Axis 


Figure 2.21. The curves ¢ = constant and @,7./2a = f,/ f, =constant in the z-plane for 
a second-order discrete-time system 


Note that the poles location depends upon Cand @p J; (or @0/Q; = fi/f,)- 
That is: 


Z=f(G Og Ts/20) =KE Sof) 
and in the z-plane the following curves can be drawn: 

z = flog T27) = ffo) for ¢ = constant 
and 


z=f(Q for @) T;/22 = fo fy) = constant 


We must remember (see Figure 1.9) that in the s-plane (continuous system) the 
curves ¢= constant are straight lines forming an angle 8 = cos“! with the real axis 
and the curves @) = constant are circles with radius @, (these two sets of curves 


are orthogonal). In the z-plane the curves z = f (@p Ts) for ¢ = constant are 
logarithmic spirals that are orthogonal in each point to the curves z: f(¢) for @ Ts = 
constant. 
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Figure 2.21 shows the set of curves z = f(¢) for @ 7/2 = constant and z = 


fog Ts/2m) for ¢ = constant corresponding to different values of ¢ and @p7,/2z 


(respectively ffs). 
We should also remember (see Section 2.3.2) that for 


fo! fr = Q la =142 1-¢7), the corresponding poles in the z- plane are 


confounded ( <z; = +7), and they are located on the segment of the real axis (- 
mC 


1,0) having an abscissa coordinate equal to — e ee 

The stability domain of the second-order discrete-time system in the plane of 
the parameters a, - a, is a triangle (see Figure 2.22). For values of a), a, placed 
inside of the triangle, the roots of the denominator of the pulse transfer function are 
inside the unit circle. 


Figure 2.22. Stability domain for the second-order discrete-time system 


2.4 Closed Loop Discrete-time Systems 


2.4.1 Closed Loop System Transfer Function 


Figure 2.23 gives the diagram of a closed loop discrete-time system. The transfer 
function on the feedforward channel can result from the cascade of a digital 
controller and of the group DAC+ ZOH + continuous-time system + ADC 
(discretized system). 
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“= 


ve y (t) 
ae + 


Figure 2.23. Closed loop discrete-time system 


Let 
o Be 
H )= 2.4.1 
E are (2.4.1) 
be the feed-forward channel transfer function with 
B) = biz + biz? +... + bn, z ™ (2.4.2) 


where the coefficients b;, b, ... by may be zero if there is a time delay of d 
sampling periods. 

In the same way as for continuous-time systems, the closed loop transfer 
function connecting the reference signal 7(¢) to the output y(f) is written as 


Holz’) _ BÐ 


2.4.3 
14+Ho f(z") A(z") + Bz) i } 


Hal(z")= 


The denominator of the closed loop transfer function, whose roots correspond to 
the closed loop system poles, is also called characteristic polynomial of the closed 
loop. 


2.4.2 Steady-state Error 


The steady-state is obtained for 7(4) = constant by making z = 1, corresponding to 
the zero frequency (z = ess = 1 for s = 0). 


It follows from Equation 2.4.3 that 


db: 
é 2.4.4 
y=Ha()rs=——r oe 


ng 


A+ D5, 
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where Hcz(1) is the steady-state gain (static gain) of the closed loop system. In 


order to obtain a zero steady-state error between the reference signal r and the 
output y, it is necessary that 


Hye (2.4.5) 


From Equation 2.4.4 the following conditions are derived: 


Sb, #0 and A(l) =0 (2.4.6) 


T= 
In order to obtain A(/) = 0, A(z!) must have the following structure: 

A(z!) = (1-2!) A(z!) (2.4.7) 
where 

A(z')=ltayz! +. +a, Z (2.4.8) 
and thus the global transfer function of the feedforward channel must be of the type 


1 Be) 
l-z" A(z 


Ho (z= (2.4.9) 


It is thus observed that the feedforward channel must contain a digital integrator in 
order to obtain a zero steady-state error in closed loop. This situation is similar to 
the continuous case (see Section 1.2.3) and internal model principle is also 
applicable to discrete-time systems. 


2.4.3 Rejection of Disturbances 


In the presence of a disturbance p(t) acting on the controlled output (see Figure 
2.23), the objective is to reduce its effect as much as possible, at least in some 
frequency regions. 

In particular, the constant disturbance effect (a step), often called “load 
disturbance”, is expected to be zero in steady-state (t —> œ, z >/). 

The pulse transfer function, which links the disturbance to the output, is 


1 7 A(z!) 
1+Ho (2) A(z) + Bz") 


Syp (2) = 


As for the continuous-time case, Syp (z1) is called “output sensitivity function”. 
The steady-state is obtained for z = /. It follows that 
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AC) 
Y=Sp DP 10 +80” 
(where p is the stationary value of the disturbance). 

In order to achieve a perfect steady-state disturbance rejection, it is necessary 
that S\,,(/) = 0 and thus A(/) = 0. This implies that A(z!) must have the form given 
in Equation 2.4.7, corresponding to the integrator insertion in the feedforward 
channel. 

Similarly, to the continuous case, a perfect steady-state disturbance rejection 
implies that the feedforward channel must contain the internal model of the 
disturbance (the transfer function that produces p(t) from a Dirac pulse). 

As in the continuous-time case, it should be avoided that an amplification of the 
disturbance effect occurs in certain frequency regions. This is the reason why |S), 


(e/®)| must be lower than a specified value for all frequencies f= w/27 < f,/ 2. 
A typical value used as upper bound is 


ISyp(eJ%)|S2 OSO 


Furthermore, if it is known that a disturbance has its energy concentrated in a 


particular frequency region, [Syp (e ®)| may be constrained to introduce a desired 
attenuation in this frequency region. 


2.5 Basic Principles of Modern Methods for Design of Digital 
Controllers 


2.5.1 Structure of Digital Controllers 


Figure 2.24 gives the diagram of a PI type analog controller. The controller 
contains two channels (a proportional channel and an integral channel) that process 
the error between the reference signal and the output. 

In the case of sampled-data systems the controller is digital, and the only 
operations it can carry out are additions, multiplications, storage and shift. All the 
digital control algorithms have the same structure. Only “the memory” of the 
controller is different, that is the number of coefficients. 

Figure 2.25 illustrates the computation structure of the control u(t) applied to 
the plant at the instant ¢ by the digital controller. This control is a weighted average 
of the measured output at instants 7, t-1,...., t-n4 .., of the previous control values at 


instants ¢-/, t-/..., t-np... and of the reference signal at instants ¢, t-/,..., the weights 
being the coefficients of the controller. 


Computer Control Systems 59 


Analog PI 


Figure 2.24. PI analog controller 


Digital controller 


Figure 2.25. Digital controller 


This type of control law can even be obtained by the discretization of a PI or 
PID analog controller. We shall consider, as an example, the discretization of a PI 
controller. The control law for an analog PI controller is given by 


Ho)= Ki 1s l Fo y(t)] (2.5.1) 
pl; 


For the discretization of the PI controller, p (the differentiation operator) is 
approximated by (1 -q`')/T, (see Section 2.3.1, Equation 2.3.6). This yields 


dx x(t)—x(t-1)_1-q" (2.5.2) 
ae OT r “O 


5 s 
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fraza] fs 3 ko (2.5.3) 
p 


and the equation of the PI controller becomes 


a KT, 
KA-4 je 
u(t) = A L r(A- yA] (2.5.4) 


Multiplying both sides of Equation 2.5.4 by (7 - q7), the equation of the digital PI 
controller is written as 


SAI ul) = Tig) rO - RG) yW) (2.5.5) 
where 

Sq) =1-qi=1l+s,q! (;=-) (2.5.6) 

R(q!) = Tq!) =K (1+T JT) -K q! =rg +r, q! (2.5.7) 


which leads to the diagram represented in Figure 2.26. 


Digital PI 


y(t) 


Figure 2.26. Digital PI controller 


Taking into account the expression of S(q~/), the control signal u(t) is computed 
on the basis of Equation 2.5.5, by means of the formula 


u(t) = u(t-L) - R(T) yO + Tig!) r() 
=u(t-1) -roy -rı yt-1) + ror) +r; rt-1) (2.5.8) 


which corresponds to the diagram given in Figure 2.26. 
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2.5.2 Digital Controller Canonical Structure 


Dividing by S(q“) both sides of Equation 2.5.5, one obtains 


T(q"') 
S(q') 


R(q') 
S(q') 


u(t) 


y+ r(t) (2.5.9) 


from which we derive the digital controller canonical structure presented in Figure 
2.27 (three branched RST structure). 
In general, 7(q~/) in Figure 2.27 is different from R(q~). 


r(t) u(t) y(t) 


, 


Figure 2.27. Digital controller canonical structure 
Consider 


B(z”') 


Hea) 


(2.5.10) 


as the pulse transfer function of the cascade DAC + ZOH + continuous-time 
system + ADC, then the transfer function of the open loop system is written as 


B(z')R(z"') 


Hole =F sah 


(2.5.11) 


and the closed loop transfer function between the reference signal r(¢) and the 
output (A), using a digital controller canonical structure, has the expression 


Be )TE") Be Te) 


Ho (z')= 
oe AHS) + BEDRE) P(E) 


(2.5.12) 


where 
P(z7') = A(Z )S(z7')+ B(ZR(z)=1+ piz! + pz”? +... (2.5.13) 


is the denominator of the closed loop transfer function that defines the closed loop 
system poles. Note that 7(q~/) introduces one more degree of freedom, which 
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allows one to establish a distinction between tracking and regulation performances 
specifications. 

We also remark that r(A is often replaced by a “desired trajectory” y'(d), 
obtained either by filtering the reference signal 7(t) with the so-called shaping filter 
or tracking reference model, or saving in the memory of the digital computer the 
sequence of the desired trajectory values. 

The digital controller represented in Figure 2.27 is also defined as “RST digital 
controller”. It is a two degrees of freedom controller, which allows one to impose 
different specifications in terms of desired dynamics for the tracking and regulation 
problems. 

The goal of the digital controller design is to find the polynomials R, S, and Tin 
order to obtain the closed loop transfer functions, with respect to the reference and 
disturbance signals, satisfying the desired performances. 

This explains why the desired closed loop performances will be expressed, (if 
not, they will be converted) in terms of desired closed loop poles, and eventually in 
terms of desired zeros (in this way the closed loop transfer function will be 
completely imposed). 

In the presence of disturbances (see Figure 2.28) there are other four important 
transfer functions to consider, relating the disturbance to the output and the input of 
the plant. 

The transfer function between the disturbance p(t) and the output (4) (output 
sensitivity function) is given by 


A(z ')S(z') 
A(z")S(z1) + B(z")R(z") 


(2.5.14) 


4 
SpE )= 


(disturbance) 
p(t) 


+ y(t) 


(noise) 
Figure 2.28. Digital control system in presence of disturbances and noise 


This function allows the characterization of the system performances from the 
point of view of disturbances rejection. In addition, certain components of S(z~/) 
can be pre-specified in order to obtain satisfactory disturbance rejection properties. 

Thus, if a perfect disturbance rejection is required at a specified frequency, S(z 
I) must include a zero corresponding to this frequency. In particular, if a perfect 
load disturbance rejection in steady-state (i.e. zero frequency) is desired, Sy” ) 
must include a term (/ - z~/) in the numerator, which leads to a value of the gain 
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equal to zero for z = /. This is coherent with the result given in Section 2.4.3., 
because a zero of Se ) corresponds to a pole of the open loop system. 

The transfer function between the disturbance p(t) and the input of the plant u(t) 
(input sensitivity function) is given by 


~ A(z!) R(z') 
A(z')S(z!) + BZR!) 


Sip(z")= (2.5.15) 


The analysis of this function allows one to evaluate the influence of a disturbance 
upon the plant input, and to specify a factor of the polynomial R(z/) if the 
controller must not react to disturbances concentrated in a particular frequency 
region. 

When noise is added to the measured output (see Figure 2.28), important 
information can be retrieved by the transfer function that relates the noise b(f) to 
the plant output y(A) (noise-output sensitivity function). 


— B(z"')R(z7') 
A(z7)S(z71) + B(z 1) R(z1) 


Sy(z)= (2.5.16) 


As the noise energy is often concentrated at high frequency, attention should be 


paid in order to obtain a low gain of the transfer function |S,,, (e/®)) in this 


frequency region. 
For T=R, the sensitivity function between r and y (also called complementary 
sensitivity function) is defined as 


BEDRE!) 


S,.(z_)= = 
we’) A(z')S(z!) + B(z")R(z) 


-S,y(z') (2.5.17) 


Note that 
SpE -SaS p ETHS p 


which implies an interdependence between these sensitivity functions. 

Notice that S„p (Z), the transfer function between the noise and the plant input, 
is equal to Sup (z/). 

Another important transfer function describes the influence on the output of a 
disturbance v(f) on the plant input. This sensitivity function (input disturbance- 
output sensitivity function) is given by 


BESE) 
A(z" )S(z") +B( ZR") 


Se = (2.5.18) 
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The importance of this sensitivity function is that it enhances the possible 
simplification of unstable plant poles by the zeros of R(z~). 

In order to clarify this point, let us consider the assumption R(z/)=A(z/) (plant 
poles compensation by controller zeros) and suppose that the plant to be controlled 
is unstable (A(z~“) has roots outside the unit circle). In this case 


5 (27)= A(z DSE) ___ S@") 
f ACZ IS(Z E) +B(ZT)AZT) S(z)+B(z}) 
4 AAE) Az) 
Sp ) < E = I a zj 
A(z )S(z)+B(z )A(z ) S(z )+B(z ) 
S (= B(z AGE) -BED 
» A(z2)S(z7)4 BEDA) S(z71) 4 Bz) 
4 BEDS) BESE”) 
S„(z7™)= = 


A(z )S(z7!)+B(z")A(z") A(z )[S(z") + Bz) 


Note that Syp, Sup, Syb are stable transfer functions if S(z/) is chosen in order to 
have S(z/)+B(z“) stable, that is 


S(z!)+B(z')=0>|,|<1 


while the sensitivity function Splat ) is unstable. 
This remark yields to the following general statement: 


The feedback system presented in Figure 2.28 is asymptotically stable if and 
only if all the four sensitivity functions Syp, Sup, Syb (or Syr) and Syv (describing 
the relations between disturbances on one hand and plant input or output on the 
other hand) are asymptotically stable. 

The set of five transfer functions Ho, (Z, Syz D, Sune?) Syaz?) (or 
Sy(z)) and S\,(z/) also play an important role in the closed loop system 
robustness analysis. 


2.5.3 Control System with PI Digital Controller 


In this section the design of digital PI controllers will be illustrated. The transfer 
(function) operator of the discretized plant with zero-order hold is given by 


Bz") Bq") bq" 


H(q"')= 
COE) AG) tag 


(2.5.19) 


For the sake of notation uniformity, we shall often use, in the case of constant 
coefficients, q1 notation both for the delay operator and the complex variable z£. 
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The z! notation will be specially employed when an interpretation in the frequency 
Dos aia JOT, 
domain is needed (in this case z =e! ). 


The digital PI controller is characterized by the polynomials (see Equations 
2.5.6 and 2.5.7): 


RG) =T) =ro+r;q! (2.5.20) 
Sq) =1-q! (2.5.21) 


The closed loop system transfer function (with respect to the reference r()) in the 
general form is given by Equation 2.5.12. 

The characteristic polynomial P(q~/), whose roots are the desired closed loop 
system poles, essentially defines the performances. As a general rule, it is chosen 
as a second-order polynomial corresponding to the discretization of a second-order 
continuous-time system with a specified natural frequency œg and damping ¢ (@ 
and ¢, for example, and can be obtained on the basis of the diagrams given in 
Figures 1.10 or 1.11) starting from specifications in the time domain. The 
coefficients corresponding to the polynomial P(g“) are obtained either by 
conversion tables mentioned in Table 2.4, or by Scilab and MATLAB” functions 


given in Section 2.3. In this case, sampling period T, natural frequency œg and 


damping ¢ must be specified. 
We recall that the relation between œg and T, must be respected (see Section 


2.2.2, Equation 2.2.7): 
0.25 < @)T,< 15; 075 6<1 (2.5.22) 
For a plant having an equivalent discrete-time transfer operator (function) given by 


Equation 2.5.19, and the use of a digital PI controller, the closed loop system poles 
are given by Equation 2.5.13, and they are 


(+a,q) -g) +b) qirgt rg) =1+p,¢! +p? (25.23) 
By rearranging the terms in Equation 2.5.23 in ascending q~! powers, we get 

1+(a,;-1+rgb) q'+(b,r,-a) q?=1+p,q' + pq? (2.5.24) 
For the polynomial Equation 2.5.24 to be verified, it is necessary that the 


coefficients of the same q`? powers must be equal on both sides. Thus the 
following system is obtained: 


fo F E (2.5.25) 


bir - 4 = Pa 
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which gives for rọ and r; the results 


- 1 
go. o. ge (2.5.26) 
bı b, 
One can see that the parameters of the controller depend upon the performance 
specifications (the desired closed loop poles) and the plant model parameters. 


By using Equation 2.5.7, one can obtain the parameters of the continuous-time 
PI controller: 


2.6 Analysis of the Closed Loop Sampled-Data Systems in the 
Frequency Domain 


2.6.1 Closed Loop Systems Stability 


In the case of continuous-time systems, it was shown in Chapter 1, Section 1.2.5, 
how to use the open loop transfer function representation in the complex plane (the 
Nyquist plot) in order to analyze the closed loop system stability and the 
robustness with respect to the parameters variations (or uncertainties on the 
parameters value). The same approach can be applied to the case of sampled-data 
systems. The Nyquist plot for sampled-data systems can be drawn using the 
functions Nyquist-ol.sci (Scilab) and Nyquist-ol.m (MATLAB®)®. 

Figure 2.29 shows the Nyquist plot of an open loop sampled-data system 
including a plant (represented by the corresponding transfer function 
H (z^) =B(z!)/ A(z“) ) and a RST controller. 

In this case, the open loop transfer function is given by 


—jo -jæ 
Haee Med (2.6.1) 
Ale S (e?) 
The vector linking the plane origin to a point belonging to the Nyquist plot of the 
transfer function represents Hoz (e/) for a specified normalized radian frequency 
@ = oT, = 2 x ffs. The considered range of variation of the radian natural 


6 To be downloaded from the book website. 
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frequency @ is between 0 and z (corresponding to an unnormalized frequency 
variation between 0 and 0.5 f, ). 


Im H 


Critical point 


=1+ H (eje 
Syp T ol) 
o =0 
Figure 2.29. Nyquist plot for a sampled-data system transfer function and the critical point 
In this diagram the point [-/, 70] is the “critical point”. As Figure 2.29 clearly 


shows, the vector linking the point [- /, j0] to the Nyquist plot of Hoz (e/®) has the 
expression 


A(z )S(z!) + B(z ")R(z') 
A(z ")S(z1) 


Sp )=l+ Hg )= (2.6.2) 


This vector represents the inverse of the output sensitivity function Syp (z-/) (see 
Equation 2.5.14) and the zeros of S~? yp (z/) correspond to the closed loop system 
poles (see Equation 2.5.13). In order to have an asymptotically stable closed loop 
system, it is necessary that all the zeros of S~/ yp (z^) (that are the poles of Syp (ZD) 
be inside the unit circle ( |z| < 7). The necessary and sufficient conditions for the 
asymptotic stability of the closed loop system are given by the Nyquist criterion. 

For systems having stable poles in open loop (in this case A(z) = 0 and S(z-~) 
= 0 — |z| < /) the Nyquist stability criterion states (stable open loop system): 
The Nyquist plot of Horz?) traversed in the sense of growing frequencies (from 
@=0 to œ = 7), leaves the critical point [-1, j0] on the left. 

As a general rule, for the given nominal plant model B(z/)/A(z“), polynomials 
R(g“) and S(q/) are computed in order to have 


A(z!) Sc!) + BEI) REL) = Pe) (2.6.3) 
where P(z~“) is a polynomial with asymptotically stable roots. As a consequence, 


for the nominal values of A(z“) and B(z~/), since the closed loop system is stable, 
the open loop transfer function: 
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= -1 
Hag- ŽE RED 
Alz Sz) 
does not encircle the critical point (if A(z“) and S(z“) have their roots inside the 
unit circle). 

In the case of an unstable open loop system, either if A(z“) has some pole 
outside the unit circle (unstable plant), or if the computed controller is unstable in 
open loop (S(z/) has some pole outside the unit circle), the stability criterion is: 
The Nyquist plot of Horz!) traversed in the sense of growing frequencies (from 
@=0 to a= 7), leaves the critical point [-1, j0] on the left and the number of 
counter clockwise encirclements of the critical point should be equal to the number 
of unstable poles of the open loop system’. 

Note that the Nyquist locus between 0.5 f, and f, is the symmetric of the 
Nyquist locus between 0 and 0.5 f, with respect to the real axis. 

The general Nyquist criterion formula that gives the number of encirclements 
around the critical point is 


N=P4 - Pb, 


where P is the number of closed loop unstable poles and P is the number of 


open loop unstable poles. Positive values of N correspond to clockwise 
encirclements around the critical point. In order that the closed loop system be 
asymptotically stable it is necessary that M =-P};. Figure 2.30 shows two 
interesting Nyquist loci. 

If the plant is stable in open loop and the controller is computed on the basis of 
Equation 2.6.3 to obtain a desired stable closed loop polynomial P(z~/) (this means 
that the nominal closed loop system is stable too), then, if a Nyquist plot of the 
form of Figure 2.30a is obtained, one concludes that the controller is unstable in 
open loop. This situation must be generally avoided’, and this can be achieved by 
reducing the desired closed loop dynamic performances (by modifying P(z-/)). 


7 The criterion holds even if an unstable pole-zero cancellation occurs. The number of encirclements 
should be equal to the number of unstable poles without taking into account the possible cancellations. 


8 Note that there exist some « pathological » transfer functions Bel yac? ) with unstable poles and/or 
zeros that can be only stabilized by controllers that are unstable in open loop. 
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1 Open Loop unstable pole 
Stable Closed Loop (a) 


Stable Open Loop 
Unstable Closed Loop (b) 


Figure 2.30. Nyquist plots: a) unstable system in open loop but stable in closed loop; 
b) stable system in open loop but unstable in closed loop 


2.6.2 Closed Loop System Robustness 


When designing a control system, one has to take into account the plant model 
uncertainties (uncertainties of the parameter values or of the frequency 
characteristics, variations of the parameters, etc.). It is therefore extremely 
important to assess if the stability of the closed loop is guaranteed in the presence 
of the plant model uncertainties. The closed loop will be termed “robust” if the 
stability is guaranteed for a given set of model uncertainties. 

The robustness of the closed loop is related to the minimal distance between the 
Nyquist plot for the nominal plant model and the “critical point” as well as to the 
frequency characteristics of the modulus of the sensitivity functions. 

The following elements help to evaluate how far is the critical point [-/, 70] (see 
Figure 2.31): 


e Gain margin; 

e Phase margin; 

e Delay margin; 

e Modulus margin. 
Gain Margin 


The gain margin (AG) equals the inverse of Ho, (e/”) gain for the frequency 


corresponding to a phase shift LP = -180° (see Figure 2.31). 

The gain margin is often expressed in dB. In other words, the gain margin gives 
the maximum admissible increase of the open loop gain for the frequency 
corresponding to “W(@) = - 180°. 

AG= 1 for Zø(@igo) = -180° 


|H o, (e79) 
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Crossover 
frequency cr 


Figure 2.31. Gain, phase and modulus margins 
Typical values for a good gain margin are 
AG =2 (6dB) [min: 1.6 (4 dB)] 


If the Nyquist plot crosses the real axis at several frequencies @;, characterized by 
a phase lag 


LWO = -i 180°; i= 1, 3,5... 


and the corresponding gains of the open loop system are denoted by 


Hon (e /®z)) , then the gain margin is defined by? 


AG= mi — 
oe) 


Phase Margin 
The phase margin (A¢) is the additional phase that we must add at the crossover 
frequency, for which the gain of the open-loop system equals /, in order to obtain a 


total phase shift ~ = - 180° (see Figure 2.31). 
Ag =180° - Z4(@,,) for [Hoe =1 


in which @,, is called crossover frequency and it corresponds to the frequency for 
which the Nyquist plot crosses the unit circle (see Figure 2.31). 


° Note that if the Nyquist plot crosses the real axis for values less than —/ and leaves the critical point to 
the left, there is a minimal value of the gain margin under which the system becomes unstable. 
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Typical values for a good phase margin are 
30° < Ag < 60° 


If the Nyquist plot crosses the unit circle at several frequencies œi, characterized 
by the corresponding phase margins: 


Ag; = 180° - 24(@;,) 
then the system phase margin is defined as 


Ag = minAg, 
I 


Delay Margin 
A time-delay introduces a phase shift proportional to the frequency @. For a certain 
frequency @p, the phase shift introduced by a time-delay 7 is 


Z9(@y) = —@ot 


We can therefore convert the phase margin in a “time-delay margin’, i.e. to 
compute the maximum admissible increase of the delay of the open-loop system 
without making the closed-loop system unstable. It then follows that: 


ATtT= 2e 
Ocr 


i 
cr? 


If the Nyquist plot intersects the unit circle at several frequencies 


characterized by the corresponding phase margins Agj, the delay margin is defined 
as 


i 


At = min — 
zi 1 
l Ow 


Note that a good phase margin does not guarantee a good delay margin (if the 
frequency @,, is high, then the delay margin is low even if the phase margin is 
important). 

The typical value of the delay margin is At 2 T; [min: 0.75Ts] 


Modulus Margin 
This concerns a more global measure of the distance between the critical point 
[-Z, j0] and the plot of Hoz (z^). The modulus margin (AM) is defined as the radius 
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of the circle centered in [-/, j0] and tangent to the plot of Hoz (Z”) (see Figure 
2.31). 
From the definition of Equation 2.6.2 of the vector connecting the critical point 


[-Z, j0] to the plot of Ho, (e/”) it follows immediately that 


-1 
max ) 


ži 
= = 72. 
| for z! =e 
max 


AM =|l+Ho,(2") 


| 


In other words, the modulus margin AM is equal to the inverse of the maximum 
value of the sensitivity function Syp (z/) magnitude. By plotting Syp (z/) 
magnitude in dB scale, the following condition is immediately derived: 


Sp") 


Se Waa TL 


dees (2.6.4) 


A(z")S(z7!) + Biz") R(z") 


Sp (e?) 


dB = AM~'dB = -AM dB (2.6.5) 


ma: 


Figure 2.32 shows the relation between the sensitivity function Sp and the 
modulus margin. 


Figure 2.32. Relation between the output sensitivity function and the modulus margin 


Therefore, the reduction (or the minimization) of |Syp (/@)| ng, Will lead to an 


increase (or maximization) of the modulus margin’. 
Typical values for a good modulus margin are 


AM 20.5 (-6dB) [min: 0.4 (-8 dB)] 


iy |Syp (G®)| max corresponds to the H s norm of the output sensitivity function. 
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Note that AM = 0.5 implies a gain margin AG = 2 (6 dB) and a phase margin A¢ > 
29°. As a general rule, a good modulus margin guarantees satisfactory values for 


the gain and phase margins!!. 
To summarize, typical values for the stability margins in a robust design are: 


e gain margin: AG > 2 (6dB) [min..: 1.6 (4dB)| 
e phase margin: 30° < Ad < 60° 

e delay margin: Ar = ae > fk [min.: 0.75 Ts] 

e modulus margin: AM > 0.5 (-6dB), [min.: 0.4 (-8dB)] 


If the plant model is known with a very good precision for a certain region of 
operation, the imposed robustness margins can eventually be less restrictive. 
The modulus margin is very important because: 


e It defines the maximum admissible value for the modulus of the output 
sensitivity function and therefore the low limits of the performance in 
disturbance rejection; 

e It defines the tolerance with respect to nonlinear or time varying elements 
that may belong to the system (the circle criterion - see below). 


Tolerance with Respect to Nonlinear Elements 
In control systems we frequently have components with static nonlinear or time- 
varying characteristics (often in the actuators). 

The characteristics of these components, without being accurately known, 
generally lie inside the conic region defined by a minimum linear gain (œ) and a 
maximum linear gain (£) — see Figure 2.33. 


Figure 2.33. Nonlinear or time-varying characteristics, contained in the conic domain (a, B) 


The closed-loop system looks, for example, like those in Figure 2.34a. 


11 The converse is not true. Systems having satisfactory gain and phase margins may have a very low 
modulus margin. 
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ri 

a) NL Block and / or TVP 
b) - 


Figure 2.34. Closed-loop systems containing a nonlinear block (NL) and / or time-varying 
parameters (TVP): a) block diagram b) equivalent representation 


H (s)= H(z’). HZ’) 


ImH el © 
Critical circle 4 ( ) 


1 ; 
a Re H(eJ® ) 


AM 


Figure 2.35. Circle stability criterion and modulus margin for discrete time systems 


From the stability analysis point of view, we may use an equivalent 
representation of such systems, given in Figure 2.34b, where 
-1 = =j 
Holz )=H (2 )H(z ). 
For this kind of system we have a generalization of the Nyquist criterion, 
known as “the circle criterion” (Popov-Zames). 


Circle (Stability) Criterion 

The feedback system represented in Figure 2.34b is asymptotically stable for the 
set of nonlinear and/or time-varying characteristics lying in the conic domain 
[œp] (with a, B>O) if the plot of Ho; (z), traversed in the sense of growing 
frequencies, leaves on the left, without crossing it, the circle centered on the real 
axis and passes through the points [-1/ P, j0] and [-1/a, j0]. 


Computer Control Systems 75 


The modulus margin AM defines a circle of radius AM centered in [-/, j0] that 
is outside the Nyquist plot of the open loop transfer function. 

Thus, the closed loop system can tolerate non-linear blocks or time-variable 
parameters described by input-output characteristics lying in a conic sector 
delimited by a minimum linear gain (/(/+AM)) and a maximum linear gain (///- 


AM)) (see Figure 2.35). 


Tolerances to Plant Transfer Function Uncertainties and/or Parameters 
Variations. 
Figure 2.36 shows the effect of the plant nominal model uncertainties and 
parameters variations on the Nyquist plot of the open loop transfer function. As a 
general rule, the Nyquist plot of the plant nominal model lies inside a “tube” 
corresponding to the accepted tolerances of the parameters variations (or the 
uncertainties) of the plant model transfer function. 

In order to ensure the stability of the closed loop system for an open loop 
transfer function H'o,(z) that is different from the nominal one Ho,(z/) (but 


having the same number of unstable poles as Hoy, (z“)), it is necessary that the 
Nyquist plot of the open loop transfer function H'oz (z”/) leaves the critical point [- 
1, j0] on the left when traversed in the sense of growing frequencies from 0 to 0.5 
Js This condition is satisfied if the difference between the real open loop transfer 
function H'oz (z/) and the nominal one Hoy; (z/) is smaller than the distance 
between the Nyquist plot of the open loop nominal transfer function and the critical 
point for all frequencies (see Figure 2.36). This robust stability condition is 
expressed by the inequality 


Hon 7) - Ho @*)|<|l+ Hor 2) = [5 |= 
AGS) +BEDRE)|_| PED |. a_p C49 
A(z')S(z7') A(z ')S(z1)} 


Figure 2.36. Nyquist plot for the nominal open loop transfer function and the real open loop 
transfer function in presence of uncertainties and parameters variations (Hop, and H’oy, are 


stable) 
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where S(z~/) and R(z/) are computed on the basis of Equation 2.6.3 for the nominal 
values of A(z~/) and B(z~). 
In other words, the magnitude of S~/ yp (e12) function (evaluated in dB units), 


obtained by symmetry from Syp (e/®) (see Figure 2.32), gives, at each frequency, a 
sufficient condition for the accepted difference (computed as the Euclidian 
distance) between the real open loop transfer function and the nominal open loop 
transfer function, in order to guarantee the stability of the closed loop. 

This tolerance is higher at low frequencies (see Figure 2.32) where the gain of 
the open loop system is high (especially when an integrator is included), and it has 
a minimum value at the frequency (or frequencies) where Sp (e/®) reaches its 
minimum (= AM), that is the frequency where S\,, (e/®) has the maximum value. 

It is necessary to ensure that at these frequencies the plant model variations are 
compatible with the obtained modulus margin. If this is not the case, the solution is 
to provide a more accurate model, or to modify the specifications in order to 
maintain the closed loop stability. 

Equation 2.6.6 expresses a robustness condition in terms of open loop transfer 
function variations (controller + plant). It is interesting to express this robustness 
condition in terms of the plant model variations only. Note that Equation 2.6.6 can 
be further expressed as 


Biz") _ BE”) 
A(z") AG) 


R(z') 
S(z1) 


Biz DRE) BEDR) 
AZDSEID AZDSz!) 


(2.6.7) 
A(z")S(z71) + B(z Rz) 
A(S!) 


< 


where B(z/)/A(z~/) corresponds to the nominal plant transfer function. 
Multiplying by |S(z/)/R(z‘)| both sides of Equation 2.6.7 one gets the 
condition 


Biz) B(z)| _|A(z7)S(z1) + B(z )R(z!) 


| gads a = 
A(z") A(z) A(z RZ) (2.6.8) 
P(z") 7- 
z =|s 
ae Pe? | 


By plotting the inverse of the input sensitivity function magnitude, sufficient 
conditions for tolerated (additive) variations (or uncertainties) of the plant transfer 
function are obtained. The inverse of the magnitude of the input sensitivity 
function is symmetric to the input sensitivity function magnitude in dB units with 
respect to the axis at 0 dB (see Figure 2.37). 

As plant model uncertainties at high frequencies are often present, one must 


verify that the maximum of |S„p (e/%)| at high frequencies is small. On the other 


Computer Control Systems 77 


hand, the input sensitivity function S„p is an effective image of the actuator stress 
in the frequency domain when disturbances act on the system. The physical 
characteristics of the actuator often impose a bound on actuator stress at high 
frequencies, and an upper bound of the maximum of |S, (e7®)| at these frequencies 
should be imposed. 

Notice that (from Equation 2.6.8) the admitted tolerances (neglecting the term 
1/R(z“)|) depend to a large extent upon the relation between the open loop system 
poles (defined by A(z~/)) and the desired closed loop poles (defined by P(z~)). 

In order to understand this phenomenon in greater detail, Figure 2.38 shows the 
S up! ) magnitude functions for a plant model characterized by A(z/)= 1 — 0.8 z1; 
B(z!)= z/ and for two different desired closed loop system characteristic 
polynomials: P)(z/)=1-0.6 z? and P2(z!)=1-0.3 z} (the controller includes an 
integrator). Note that P2(z/) corresponds to a closed loop system faster than the 
one specified by P;(z“), and both closed loop systems are faster than the plant 
(open loop system). 

The |S, (Z D| maximum for P,(z-/) is greater than for P,(z/), and then the 
inverse of Sup(z-)| will be smaller. As a consequence, the accepted tolerances for 
the frequency response variations (especially at high frequencies) are smaller in the 
case of P2(z/) with respect to the case of desired closed loop performances 
imposed by P(z“). 


Syp| dB 
ISu Bounds on the actuator requirements 


[Supl 


(Tolerance to additive uncertainties) 


Figure 2.37. The input sensitivity function and its inverse 


78 Digital Control Systems 


Input Sensitivity Function 


Magnitude (dB) 


Frequency (f/f ) 


Figure 2.38. Input sensitivity function for the plant model q`! /(1 — 0.8 q`!) as a function of 
the desired closed loop performances 


Equation 2.6.8 gives a sufficient condition for the accepted (additive) tolerance 
in terms of real plant transfer function parameters variations (or uncertainties) with 
respect to the nominal plant transfer function. 

Moreover, we may be interested in the evaluation of the accepted relative 
tolerance with respect to the nominal plant transfer function magnitude. It follows 
from Equation 2.6.8 that 


Biz) Bz") 

Ate) AZ| [AG DSE DBE DRE) 
BE”) Bz ')R(Z") (2.6.9) 
A(z) 

es ae ee ee 

= ene Baene 


where Syp is the “noise-output sensitivity function” and S, is the complementary 
sensitivity function. 

The noise-output sensitivity function S,, allows the definition of a frequency 
“template” to ensure that the “delay margin” constraint is fulfilled. Let consider the 
case of a delay margin At =1- T; . 


It follows that 
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Hehe 2) ; gj e (2.6.10) 
A(z) A(z) 
and consequently 
r7_—l = -l 
A ae E (2.6.11) 
H(z) 
Equation 2.6.9 becomes 
ISed ; z=el® 0<@<a (2.6.12) 
"Bed 
or in dB units 
S3 (cag < -20 togh z aT > z=el® 0<@<a_ (2.6.13) 


Noise-output Sensitivity Function Template 


Magnitude (dB) 
A 


"ea, 


7 a TSE, ENE EEEE, PEE EEE Orc EES, TE EEA 
f | | | | | | | | 
| | | | | | | | | 
| | | | | | 1 | | 
-8 1 i t t t 1 1 i t 
0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 
Frequency (fff) 


Figure 2.39. Frequency template for the noise-output sensitivity function and At = T, s 
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This expression defines a frequency robustness template for the sensitivity 
function S. This template corresponds to the frequency response of a digital 


integrator and is represented in Figure 2.39. 
As the modulus margin introduces a frequency template on the output 


Sy (e2) < -AM ; 0<@<z), we are interested in finding 


what template is introduced by the delay margin on | S,,]. 
From Equations 2.5.14 and 2.5.17 it results that 


sensitivity function ( 


Sy) (z")=14S,, (2) (2.6.14) 
and by means of the triangle inequality it follows that 


-|s e| slsp ess] (2.6.15) 


Taking into account the frequency bound on S,, given by Equation 2.6.12, the 
following condition is obtained : 


yp 


-h-z <|s ()/st4l-247" (2.6.16) 


Output Sensitivity Function Template 
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Figure 2.40. Frequency template on the output sensitivity function for AM = 0.5 (-6dB) 
and Ar=T, 
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that leads to the robustness template on |S,p| represented in Figure 2.40. 

Notice that, from the point corresponding to 0.17 fs , |Syp] must lie inside a 
region delimited by an upper and a lower bound and that, for frequencies below 
0.17 fẹ, the frequency template for the modulus margin also assures the delay 
margin constraint to be respected. 

It is important to note that the template on Sp will not always guarantee the 
desired delay margin (it is an approximation). If the condition on |S}, is satisfied, 
then the condition on |S\,| will also be satisfied. However, if the condition on |S}, 
is violated, this will not imply necessarily that the condition on |S,p| will also be 
violated. In practice, the results obtained by using the template on the |Sj,| are very 
reliable. 

The following remark is important: the closed loop system robustness will be, 
in general, reduced when the closed loop system bandwidth is increased with 
respect to the open loop system bandwidth. Conversely, for a relevant reduction of 
the rise time for the closed loop system, with respect to the open loop system rise 
time, a good estimation of the plant model is required (especially in the frequency 
regions where |S,»(z1)| is high). 

As a consequence, robustness constraints can imply either a small reduction of 
the closed loop system rise time (with respect to the open loop system rise time), or 
a controller design which takes into account the bounds on the sensitivity 
functions. 

An important challenge in control system design is the maximization of the 
controller robustness for given performances. This is obtained by minimizing the 
sensitivity functions maximum in the critical frequency regions. 


2.7 Concluding Remarks 


Recursive (differences) equations of the form 


ny Np 


y(t) =-) ay(t-i)+_ bu(t-d-i) (2.7.1) 
i=l i=l 


where u is the input, y is the output and d is the discrete-time delay, are used to 
describe discrete-time dynamic models. 

The delay operator q? [q] y(t) = y(t-1)] is a simple tool to handle recursive 
equations. If the operator q`} is used, the recursive Equation 2.7.1 takes the form 


A(q"') y(t) =q B(q u(t) 
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where 


ny A Np , 
Aq!) =1+ J ag B(q')=1+ bq" 


i=] i=l 


The input-output relation for a discrete-time model is also conveniently described 
by the pulse transfer operator H(q/): 


y(t) =H u(t) 


where 


-d py, -l 
ER me ) 


The pulse transfer function of a discrete-time linear system is expressed as function 
of the complex variable z= es (T, = sampling period). The pulse transfer 
function can be derived from the pulse transfer operator H(q~!) by replacing q7 
with z. 

The asymptotical stability of a discrete-time model is ensured if, and only if, all 
pulse transfer function poles (in z) lie inside the unit circle. 

The order of a pulse transfer function is 


n = max (n4, ng + d) 


In computer controlled systems, the input signal applied to the plant is held 
constant between two sampling instants by means of a zero-order hold (ZOH). The 
zero-order hold is characterized by the following transfer function: 


=sT, 


ž 


l-e 
Hagia — — 


Therefore, the continuous-time part of the system (between digital-to-analog 
converter and the analog-to-digital converter) is characterized by the continuous- 
time transfer function 


H' (s) = Hzon (9) . H(s) 


where H(s) is the plant transfer function. 

In computer controlled systems, the input signal applied to the plant at time ¢ is 
a weighted average of the plant output at times ¢, ¢-/, .... -n4+J, of the previous 
input signal values at instants ¢-/, +2, ..., t-ng-d, and of the reference signal at 
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instants ¢, ¢-/,..., the weights being the coefficients of the controller. The 
corresponding control law (controller RST) is written as 


SAI ul) = -RGI vO + TAY ro) (2.7.2) 


where u(t) is the control (input) signal to the plant, y(A) is the plant output and r(t) 
is the reference. 

The transfer function of the closed loop system (between the reference signal 
and the plant output) that includes the digital controller of Equation 2.7.2 is given 
by 


B(z")T(z") 


Hale )= ADSI + BZ RZ) 


where H(z!) = B(z!)/A(z“) is the pulse transfer function of the discretized plant 
(in this case B(z~/) may include possible delays). 
The characteristic polynomial defining the closed loop system poles is given by 


PEL) = AEL) SEL) + BEY) RE!) 


The disturbance rejection properties on the output result from the output sensitivity 
function frequency response 


A(z)S(z') 
A(z7)S(z71) + B(z)R(z) 


S,(z") = 


Robust stability of the closed loop system, with respect to the plant transfer 
function uncertainties or parameters variations, is essentially characterized by the 
modulus margin and the delay margin. 

The modulus margin and the delay margin introduce frequency constraints on 
the magnitude of the sensitivity functions. These constraints lead to the definition 
of frequency robustness templates that must be respected. 

The robust stability (or performance) of the closed loop system robustness, with 
respect to the plant transfer function uncertainties or parameters variations, 
depends upon the choice of the desired closed loop system performances 
(bandwidth, rise time) with respect to the open loop system dynamics. A 
significant reduction of the closed loop system rise time (or a significant 
augmentation of the bandwidth of the closed loop system), compared to the open 
loop system rise time (or bandwidth), requires a good estimation of the plant 
model. 

In order to ensure closed loop system robustness, when a good estimation of the 
plant model is not available, or when large system parameters variations occur, the 
closed loop system rise time acceleration, compared to the open loop system rise 
time, must be moderate. However, some methods exist for maximizing the 
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controller robustness with respect to plant model uncertainties (or parameters 
variations), for given nominal performance. 
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Zames G. (1966) On the input-output stability of time-varying nonlinear feedback 
systems, IEEE-TAC, vol. AC-11, April, pp. 228-238, July pp. 445-476. 

Narendra K.S., Taylor J.H. (1973) Frequency Domain Criteria for Absolute 
Stability, Academic Press, New York. 


For a generalization of the concepts of robustness margins and robust stability 
introduced in this chapter, see Appendix D. 
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Robust Digital Controller Design Methods 


In this chapter the design of model based robust digital controllers is discussed. 
The design of digital PID controllers is first presented, emphasizing the general 
structure of digital controllers (three branched structure known as RST), the 
special features of the digital approach and the limitations of the digital PID. The 
following design methods are then presented: pole placement, tracking and 
regulation with independent objectives and tracking and regulation with internal 
model control. The presentation is done from the perspective of robust control. 
These methods permit the control of systems of any order with or without time 
delay. The last section of the chapter presents a general methodology for the 
design of robust digital controllers by means of sensitivity functions shaping. 


3.1 Introduction 


The use of a digital computer or microprocessor in control loops offers several 
advantages. These include: 


e Considerable choice of strategies for controller design 

e Possibility of using algorithms which are both more complex and 
more efficient than the PID 

e Technique perfectly suited for the control of systems with time dela; 

e Technique well suited for the control of systems characterized by 
linear dynamic models of high order (including systems with multiple 
low damped vibration modes) 


Moreover, by combining the controller design methods with the system model 
identification techniques, a rigorous, high performance controller design procedure 
can be implemented. These aspects are covered in Chapters 7, 8 and 9. 
The digital controller design methods that are presented in this chapter relate to 
single input-single output control in the presence of deterministic disturbances. 
These methods are: 


e = Digital PID 
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e Pole placement 

e Tracking and regulation with independent objectives 
e Tracking and regulation with internal model control 
e Pole placement with shaping of sensitivity functions 

All the controllers, irrespective of their design method, will have the same RST 
three-branched structure (see Figure 2.27). Only the memory of the controller 
(number of coefficients) will vary depending on the complexity of the system. 

Note that in the case of simple systems (at most second-order and small time 
delay), the various controllers designed by means of the pole placement, tracking 
and regulation with independent objectives and internal model control, correspond 
to digital PID controllers having differently tuned parameters. 

The tracking and regulation with independent objectives and tracking and 
regulation with internal model control can be considered as particular cases of the 
pole placement. They result from a particular choice of the desired closed loop 
poles. 

The robustness of the designed control system with respect to plant model 
uncertainties is a very important issue. The pole placement with shaping of 
sensitivity functions is a general methodology of digital control design that allows 
one to take into account simultaneously robustness and performances 
specifications for the closed loop. 

The digital control design by pole placement (and the various particular cases) 
is a predictive control (the controller implicitly contains a predictor of the plant 
output). This will be illustrated in Sections 3.4.4 and 3.5.3 and in Appendix B. 

The design and tuning of digital controllers require the knowledge of the 
discrete-time model of the plant to be controlled (model based control). It is not 
possible to implement effectively a high performance control loop without 
identifying the plant model. Fortunately the system identification methodology is a 
mature subject and toolboxes or dedicated software are available. System 
identification is discussed in Chapters 5, 6, 7 and 9. 

If the continuous-time model of the plant to be controlled is available, the 
discrete-time model of the sampled-data system can be obtained by using 
appropriate discretization techniques. The functions cont2disc.sci (Scilab) and 
cont2disc.m (MATLAB"), available on the book website, can be used for this 


purpose. 


3.2 Digital PID Controller 


The basic version of the digital PID controller considered in this book results from 
the discretization of the continuous-time PID controller presented in Section 1.3.2. 
Another version, which provides some advantages, will also be presented. 
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The methodology for the digital PID controllers design to be presented is 
rigorously applicable only to!: 


e Plants that can be modeled by a continuous-time system characterized by a 
transfer function of maximum degree equal to 2, with or without time delay 
e Plants having a time delay which is less than one sampling period 


Although continuous-time PID parameters can be recovered from the digital PID 
controller design, in some cases, the discrete-time methodologies have not been 
developed for the tuning of continuous-time (or pseudo-digital) PID controllers. 
Specific methodologies exist and should be used for the tuning of continuous time 
PID controllers (see Chapter 1, Section 1.3). Moreover, it should be pointed out 
that certain tunings of digital PID controller parameters offering excellent 
performances have no counterpart in terms of continuous-time PID controller 
parameters. 


3.2.1 Structure of the Digital PID 1 Controller 


Consider the transfer function of the continuous-time PID controller (Equation 
1.3.2): 


H pp (s) = K| 1+ — + (3.2.1) 


This controller is characterized by four tuning parameters: 


e K — proportional gain 
e T; — integral action 
e Ti — derivative action 


e T/N -filtering of the derivative action 


Several discretization methods may be used to derive the structure of the digital 
PID controller. The relations between the continuous-time and discrete-time 
parameters will depend on the method used, but the structure of the digital 
controller will remain the same. 

Since in our case the design and implementation of the controller will be in the 
discrete-time, the discretization method is not essential. For this reason we will use 
the backward difference approximation. It follows that s (derivative) will be 
approximated by (J - qT. ņ and //s (integration) will be approximated by 


T, AJ - q’) (see Section 2.3, Equations 2.3.6 to 2.3.11 ). 


' A method for the design of digital PID controllers for plants characterized by high order models is 
presented in Chapter 10, Section 10.5. It is based on the complexity reduction of a model based 
controller. 
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This produces 
Peg tet + (3.2.2) 
Ts T, l-q 
Tes disg (3.2.3) 
T, 
NT, 
1 1 T; +NT 
= = d 5 (3.2.4) 
Tı Tı -1 Ta -1 
jety ja (lsg) 1-5 g 
N NT, Ta +NT;, 


By introducing these expressions in Equation (3.2.1), the pulse transfer function 
(operator) of the digital PID 1 controller is obtained?: 


NT; 


Rq’) TE eae 
Hom) = 4 k| iaai (3.2.5) 
S(q ) T; l-q jut g 
Ti + NT, 


The expression in terms of the ratio of two polynomials is obtained by summing up 
the three terms. Polynomials R(q~/) and S(q~/) have the form 


RGI) =r9 +r, q! +12 q7 (3.2.6) 
Sq) =U-q) +s, q)=(+s5,¢'+5,¢7) (3.2.7) 
where 
s =- T4 5 paR Niss! 
Ta + NT, T; Ta 
T T; 
n =K] s| 1+ +2N— 1 T = -Ks (+ N22) 
T, Ty Ty 


? As indicated in Section 2.5.3, for systems with constant coefficients the notation ql will be used both 


for the backward delay operator and the complex variable zl , with the exception of cases that require 
an interpretation in the frequency domain. 
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The digital PID 1 controller has four parameters (rp, rj}, >, 5’;) as the continuous- 


time PID controller. 

Note that the pulse transfer function (operator) of the digital PID 1 controller 
contains as a common factor of the denominator the term (/-q~/), which assures the 
behavior of the numerical integration. The denominator also contains the term 


(IFs q! ), which is a digital filter that plays the role of the filter [J + (7,/N) s] in 
the continuous-time PID controller. 


r(t) u(t) y(t) 


Figure 3.1. Equivalent block diagrams of a digital control loop using the digital PID 1 
controller 


The equivalent block diagram is given in the upper part of Figure 3.1. By 
taking 7(q-/) = R(q™‘), the digital PID 1 controller can take the standard three 
branched structure of the RST controller, as shown in the lower part of Figure 3.1. 

The pulse transfer function (operator) of the closed loop relating the reference 
r(¢) and the output (A) is 


BADR” _ BADR) (3.2.8) 
A(q"')S(q') + B(q"')R(q”') P(q') 


Halq”) = 


in which the polynomial P(g~/) defines the desired closed loop poles (directly 
linked to the desired regulation performances). 

The product B(q/)R(q-/) defines the closed loop zeros. The digital PID 1 
controller, in general, does not simplify the plant zeros (unless B(q-/) is chosen as a 
factor of P(q-/)) and thus can be used for the regulation of plants having a discrete- 
time model with unstable zeros (a situation occurring, for example, if there is a 
fractional time delay greater than half of a sampling period, see Section 2.3.7). 

Furthermore, the digital PID 1 controller introduces additional zeros defined by 
R(q/) that will depend on A(q~!), B(q~!) and P(q-') and thus which cannot be 
specified a priori. In certain situations, these zeros may produce undesirable 
overshoots during the transient (see the examples given later on in Section 3.2.3). 
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3.2.2 Design of the Digital PID 1 Controller 
The computation of the parameters involves several stages: 


1. Determination of discrete time plant model 
Specification of the performances 

3. Computation of the controller parameters (the coefficients of the 
polynomial R(q~/) and S(q-/)) 

4. Verification of the achieved robustness margins and sensitivity functions 


Discrete-Time Plant Model 


This is the pulse transfer function H(z!) of the sampled model of a plant having 
the transfer function H(s), and controlled through a zero order hold as is indicated 


in Figure 3.2. 
~ / 


| H(z) 


Figure 3.2. Pulse transfer function of a plant 


1 


Continuous-time transfer functions of the following form may be considered: 


Ge 
H(s)= 3.2.9 
(s) l+sT ( ) 
or 
pe 
H(s) = —— - (3.2.10) 
0) +2¢@ sts 
with the restriction 
CAT. (3.2.11) 


Note moreover that for the first-order system the sampling period T, must be 
smaller than T (T, < T — see Equation 2.2.4 ). It thus means that the digital PID 
controller design can be correctly applied only to the first-order system with a time 
delay verifying the condition t< T. 


For these two types of continuous-time models, discretization with hold results 
in a pulse transfer function (operator) of the form 
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bqitbhq _ Bq") 
lt+aqq't+aq? A(q') 


H(q')= (3.2.12) 


The transfer function H(q~“) may be obtained: 


e Directly by identification of the discrete-time plant model 

e From knowledge of H(s) and T, using discretization routines (as for 
example cont2disc.sci (Scilab) and cont2disc.m (MATLAB®*)) or 
transformation tables 


Specification of the Performances 

As a general rule, the desired closed loop system performances can be expressed in 
terms of the parameters of a pulse transfer function. This may be expressed by the 
condition 


BARG’) _ Bulg") (3.2.13) 


Halq”) = 
aa = DSD DRG) PUT 


However, By(q7) cannot be specified a priori since, in general, B(q™/) is not 
simplified (unless B(q~/) is stable, which corresponds to cases where the time delay 
is negligible); moreover, the controller itself introduces zeros by means of R(q~/). 


The closed loop polynomial remains to be specified. The polynomial P(q~/) is 
chosen of the form 


P(g!) =] +p; gq! + p's q? (3.2.14) 


A recommended method for defining p’; and p’, consists first in considering a 


second-order normalized continuous-time model (see Section 1.1.6), enabling a 
rise time (fp) or a settling time (tç) and a maximum overshoot (M) to be obtained in 


accordance with the specifications. This choice may be done using the diagrams 
given in Figures 1.10 and 1.11 or using the functions omega_dmp.sci (Scilab) and 
omega_dmp.m (MATLAB")}. That allows determining the parameters @p and ¢ of 
the second-order system. The sampling period T, and the natural frequency œp 
should verify the condition 


(23 < T, 215 ; 07<¢<]1 (3.2.15) 


The discretized model with hold can be computed either by means of the functions 
cont2disc.sci (Scilab) and cont2disc.m (MATLAB®™), or by means of 


3 Available from the book website. 
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transformation tables (see Section 2.3.6). The denominator of the pulse transfer 
function thus obtained will represent the polynomial P(q~). 


Computation of the Coefficients of the Digital Controller 
From Equation 3.2.13 it results that the following polynomial equation must be 
solved: 


P(g!) =A) S(¢)) + Ba) RAI) (3.2.16) 


in the unknown polynomials S(q~/) and R(q~/). In Equation 3.2.16 P(q~/) is given 
by Equation 3.2.14 and A(q~“) and B(q~) are given by Equation 3.2.12 . The 
structures of R(q~“) and S(q~“) are given respectively by Equations 3.2.6 and 3.2.7. 
Equation 3.2.16 is a Bezout polynomial equation. 

The detailed version of Equation 3.2.16 is 


P(q7')=1+ pig”! + pq? = AGS) + Bq") RQ") 


=(l+aq' +a,q~)-q'\l+siq") 


(3.2.17) 
+ (biq + bog (ro + nq + nq) 
= A(q"')S'(q')+ Bq )R(q") 
where 
A(g')= AGU- q) = (14 aig"! + asg’ + aig’) (3.2.18) 
= (L+ (a -1)q™ + (a, -a,)q° -a,q™°) 
S'q")=1+ sq" Jai 


Solving a polynomial equation implies that coefficients related to the powers of q 
should be equal on both sides. One observes that the maximum order on the right 
hand side is q~ (it is a system of four equations in four variables that must be 
solved). The higher order of the left side of the equation is q-?, that corresponds to 
a zero value for the coefficients of gq and q4 powers in the polynomial P(q~“). In 
fact, it is possible to impose non-zero values for these coefficients. 

In general one imposes 


-l 1 2 3 4 
Pq )=(+ pig + Pod ^ + P39 + Pad )= 


= f 5 (3.2.20) 
=(l+piq + poq “\lit+aq Xl+azq ^) 


where coefficients p; and ph result from the discretization of a second-order 
continuous-time system with @, and ¢ corresponding to the specified nominal 


performances, and with @,,@, corresponding to aperiodic “auxiliary poles” —a, 
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and —a, located on the real axis (inside the unit circle) and corresponding to a 


frequency higher than @g / 27 (see Figure 3.3). 


Dominant poles 


-1 1 2™ order system 


(Wo , 6) 
-j Auxiliary poles 


Figure 3.3. Dominant and auxiliary poles for the design of a digital PID controller 
One observes that —a@, and -æ> are smaller than the real part of the dominant 
poles (then they are faster poles). The introduction of auxiliary poles allows 


improving the robustness of the controller. In practice, a typical choice is either 
Q@, =æ, Or a, =0 and the ranges for their values are 


—0.05 < a, ,a@, < —0.5 (3.2.21) 
The system of four equations to solve is 

Pi =b +5, +a] 

Pa = bot) + bir, + siaj +a, 

P3 = bon, + bir, + sia, + a3 

P4 = bzn +5143 


The equivalent matrix form of this system of equations is 


Mx=p (3.2.22) 


where 
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< SLs ete (3.2.23) 
p” =[L Pi P2, P3» P4] (3.2.24) 


and the matrix M is of the form 


The solution of Equation 3.2.22 is expressed by 
x=M""'p (3.2.25) 


where M~! is the inverse matrix of M. In order to assure the existence of this 
inverse, it is necessary that the determinant of M is non-null. It can be shown that 
this condition is verified if, and only if, A(q“) and B(q~) are coprime polynomials 
(no simplification between zeros and poles). 


Exercise 
Let 


E g p ie Bi. 
Bq) = biq” +b)q~ =bg L 1) 
1 


Aq") = (leq a+ eq) 
1 


Show that in this case det M =0. 
In order to solve the Bezout equation, one can use the function bezoutd.sci 
(Scilab) or the function bezoutd.m (MATLAB®) available on the book websitet. 
The parameters of the continuous-time PID controller, which by discretization 
with a sampling period equal to T, gives the digital PID controller with 


polynomials R(q-/) and S(q-/), are computed by means of the following relations: 


_ nsi ~~ (24+ Sry 
(1+ st)’ 


K (3.2.26) 


4 In Scilab and MATLAB” environments one must specify A (qi ) and Bq ) to obtain S (qi ) and 
RD). sq) is obtained by using Equation 3.2.7. 
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_K(+5)) 


T, =T, (3.2.27) 
'o + n + h 
p-r imta (3.2.28) 
*  K(1+s')° 
Toa Tas, (3.2.29) 
N 1+s; 


For the digital PID controller to be equivalent to a continuous-time PID controller, 
it is necessary that the coefficient s', verify the condition 


-1<s',<0 (3.2.30) 


In the opposite case (0<s',<1), the digital filter 1/1+s' q”) is stable but 


without a continuous-time equivalent (as a first-order filter). The digital PID 
controller in this case may provide very good performances but an equivalent 
continuous-time PID controller cannot be obtained (see examples given in Section 
3:2.3). 


3.2.3 Digital PID 1 Controller: Examples 


We consider the case of the regulation of a first-order plant with time delay having 
the following characteristics: 


e Gain(G)=/; Time Constant (7) = 10s; Pure time delay (7) = 3 s 
e A sampling period T, = 5 s is chosen in order to verify the conditions: 
7<T,andT,<T 


The objective of the design is to obtain the best closed loop performances without 
overshoot. The damping factor of the model that specifies the performances is 
fixed at ¢= 0.8, and the natural frequency œg will be chosen in the range: 


0.25 < oT, < 1.5. 


For @ = 0.05 (@ T, = 0.25), the results obtained are summed up in Table 3.1. 


The model output y(t) and the control signal u(t) are displayed in Figure 3.4. It 
can be observed that the closed loop step response (about /37s= 65 s) is slower 
than the open loop step response (about 2.27 + t =25 s) since the control u(t) sent 
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Table 3.1. Digital PID 1 controller, œg = 0.05 rad/s 


Plant: 
© Bg!) = 0.1813 q} +0.2122 q? 
© Aq?!) =1-0.6065 q! 
e Ts =5s,G=1, T= 10s, t= 3 
Performances > Ty=5s , ap =0.05 rad/s, C=0.8 


*** CONTROL LAW *** 


Sq). uf) + RG). v0 = TA). rO 

Controller: 

© Rg!) = 0.0621 + 0.0681 q1 

© Sq) =(1-q!)- (1 - 0.0238 q1) 

e T@ID=RGÌ 
Gain margin: 7.712 Phase margin: 67.2 deg 
Modulus margin: 0.751 (-2.49dB) Delay margin: 45.4 s 
Cont. time PID: k = -0.073, Ti = -2.735, Td = - 0.122, Td/N = 0.122 


Time (tT) 


Figure 3.4. Performances of the digital PID 1 controller, œg = 0.05 rad/s for tracking and 


regulation 
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by the controller represents a filtered step. This situation is well known in practice. 
For time delays greater than 20 or 25% of the time constant, the continuous time 
PID controller slows down the closed loop system with respect to the open loop 
system. Can a digital PID controller therefore provide improved performances? 

Take @) = 0.1 rad/s (twice faster desired closed loop response). The 
computation results are summed up in Table 3.2 and the evolutions of the plant 
output and of the control applied to the plant are represented in Figure 3.5. 

By examining the results given in Table 3.2, first one can see that s’; is positive, 
and therefore an equivalent continuous-time PID controller does not exist. 

An acceleration in the plant response is observed, but this is accompanied by 
the appearance of a slight overshoot (larger than the one corresponding to ¢ = 0.8). 

The explanation of this overshoot is given by the coefficients of T(q/)=R(q). 
The polynomial 7(q/)=R(q‘), which introduces zeros in the pulse transfer 
function, has now its second coefficient with a negative sign. As the zeros have 
influence on the first instants of the response, the contribution of R(g~/) is a 
positive jump followed by a negative one, and the step on the reference filtered, by 
R(q“) is characterized by a peak related to the difference rg - rj, that is not 
completely attenuated by the remaining components of the pulse transfer function. 

In order to avoid an excessive overshoot with this structure of the PID, one 
needs (for ¢> 0.7) to have all coefficients of R(q~) positive. 

Taking œ = 0.15 rad/s (Table 3.3 and Figure 3.6), a significant acceleration of 
the step response is obtained, but the overshoot becomes larger. As in the previous 
case, there is no equivalent continuous-time PID controller. It is also observed that 
the difference ry - r; is greater, thus explaining the increased overshoot. 


Table 3.2. Digital PID 1 controller, œg = 0.1 rad/s 


Plant: 

© Bg!) = 0.1813 g! + 0.2122 ¢? 

© Ag!) =1 - 0.6065 q! 

© 1) =5s, G=1, T=10s, r=3 
Performances >T;=S5s , @g=O0.l rads, C=0.8 


*** CONTROL LAW *** 


Sq!) uO + RG) yO = Ta"). 

Controller: 

© Rg) = 0.8954 - 0.4671 q! 

© Sql) =(-q!). 1 + 0.16343 g!) 

e Mg) = RG) 
Gain margin: 6.046 Phase margin: 65.9 deg 
Modulus margin: 0.759 (- 2, 39 dB) Delay margin: 16.8 s 
Cont. time PID: (no equivalent) 
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Table 3.3. Digital PID 1 controller, œg = 0.15 rad/s 


Plant: 

© Ba!) = 0.1813 ¢! + 0.2122 q? 

© Ag!) =1- 0.6065 q? 

e Ts =5s, G=1, T=10s, t=3 
Performances > Ts=5s , @g=O0.15 rad/s, €=08 


*** CONTROL LAW *** 


Sq!) u + RG). = Ta). 

Controller: 

e Rg!) = 1.6874 - 0.8924 q1 

e Sq) =(-q!). (+ 0.3122 q1) 

© 1) =R@!) 
Gain margin: 3.681 Phase margin: 58.4 deg 
Modulus margin: 0.664 (- 3.56 dB) Delay margin: 9.4 s 
Cont. time PID: (no equivalent) 


Time (tT) 


Figure 3.5. Performances of the digital PID 1 controller, œg = 0.1 rad/s for tracking and 


regulation 
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In order to eliminate the undesirable effect of the zeros introduced by the digital 
PID 1 controller, another structure must therefore be chosen for T(q-1), which does 
not introduce additional zeros in the closed loop transfer function. That leads to the 
digital PID 2 controller. 


3.2.4 Digital PID 2 Controller 
This is a digital PID that does not introduce additional zeros. 


The desired closed loop transfer function (between the reference and the 
output) will be of the form 


_ PO BY") (3.2.31) 


MaM I= Bay Pg) 


in which B(q~/) contains the plant zeros that will remain unchanged. P(q~) defines 
the desired closed loop poles and the term P(/)/B(/) is introduced in order to 
ensure a unit gain between the reference and the output in steady state. 

The controller will have the general structure 


SAD uW + RC) yo = Te) rA (3.2.32) 


Plant Output 


==4= 
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Time (tT) 


Figure 3.6. Performances of the digital PID 1 controller, œg = 0.15 rad/s for tracking and 


regulation 
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in which S(q/) and R(q~) are given by Equations 3.2.6 and 3.2.7 respectively. 
The closed loop transfer function using the controller specified by Equation 
3.2.32 will be 


TDB’) _IPO/BOBUD 8233) 


Hag) = 
7 ADSG) + BATRA) P(q') 


In the same way as the PID1, the coefficients of the polynomials S(q“) and R(q ^ 
will be obtained by solving Equation 3.2.16 . It thus results from Equation 3.2.33 
that 


— PQ) BORM _ 
BO BD) 


T(q") R(1) (3.2.34) 


since S(/) = 0 (which implies P() = B(/) R(1)). Then 7(q-/) will be a gain equal 
to the sum of the coefficients of R(q~). 

To conclude: the digital PID 2 controller has the same polynomials S(q-!) and 
R(q'!) as the digital PID 1 controller; the only difference is that now T(q7!) = R(1) 
instead of R(q"!), thereby preserving the unitary gain of the closed loop system in 
steady state without however introducing the effect of the zeros of R(q’!). 

The continuous-time PID (structure 2) that leads by discretization to the digital 
PID 2 controller is represented in Figure 3.7 (proportional and derivative actions 
only on the measure). 


Figure 3.7. Continuous-time PID controller corresponding to digital PID 2 controller 


The parameters of the continuous-time PID 2 controller, which leads by 
discretization with a sampling period equal to 7, to the digital PID 2 controller 


with polynomials R(q~/) and S(q-/), result from the following relations: 


eae) (3.2.35) 


' 
1+ 5; 
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T,=T. Sire) (3.2.36) 


S 
Fo +r +r 


' ' =] 
1, =7, anan (3.2.37) 
© (A +2r,)0+57) 


at es (3.2.38) 
Nits, 


Just like the PID 1 digital controller, for the PID 2 digital controller to be 
equivalent to a continuous-time PID controller, the condition of Equation 3.2.30 on 
the coefficient s', must be satisfied (that is -7 < s'; < 0). 

Table 3.4 gives the computation results of the digital PID 2 controller for the 
same plant which was considered in the case of the digital PID 1 controller, and 
with a desired closed loop natural frequency œg = 0.15 rad/s (the results are to be 
compared with those given in Table 3.3; the values of the coefficients of R(q”) and 
S(q”) are the same). 


Table 3.4. Digital PID controller (structure 2) œg = 0.15 rad/s 


Plant: 

© Bq!) = 0.1813 q1 +0.2122 q7? 

e Ag!) =1 - 0.6065 q! 

e Ts =5s, G=1, T=10s, t=3 
Performances >T7;=S5s , @g=O0.15 rad/s, ¢= 0.8 


*** CONTROL LAW *** 


Sq) ud) + RG) = Tq) ro 
Controller: 


© R(T!) = 1.6874 - 0.8924 q1 

© Sq) =(A-q4) (1+ 0.3122 g1) 

e Tq!) = 0.795 
Gain margin: 3.681 Phase margin: 58.4 deg 
Modulus margin: 0.664 ( - 3.56 dB) Delay margin: 9.4 s 
Cont. time PID: (no equivalent) 


The performances obtained are illustrated in Figure 3.8, which must be compared 
with the curves of Figure 3.6. It can be observed that for the same values of the 
polynomials R(q”) and S(q”), the overshoot during the transient disappears when 
the digital PID 2 controller is used (for steps on the reference). Moreover, the 
response to a disturbance is the same for PID1 and PID2. 
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Note also that the values obtained for the required robustness margins (gain, 
phase, modulus, delay) are without doubt satisfactory. 


3.2.5 Effect of Auxiliary Poles 


Figures 3.9 and 3.10 show the frequency characteristics of and for three 


S yp S up 


PID controllers designed for the same plant model used in the previous sections 
with the following performances specifications: 


© @)=90.25 rad/s ; ¢=0.8; 
e @) =0.20 rad/s ; €=0.8; 
e @) =9.25 rad/s ; ¢ =0.8 and two auxiliary poles -a@, =-a, = 0.15. 


<0OdB 


corresponds to the attenuation band for the disturbances. The frequency regions 
S p 


In Figure 3.9 the frequency region (low frequencies) where Sa 


where > 0 dB correspond to an amplification of the disturbances. At the 


frequencies where |S 


yp|=9dB the system behaves “in open loop” since the 


disturbances, at these frequencies, are neither amplified nor attenuated. 


Plant Output 
T 


T T T T 


Time (tT) 


Figure 3.8. Performances of the digital PID 2 controller, œg = 0.15 rad/s for tracking and 
regulation 
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Figure 3.9. Frequency characteristics of the modulus of the output sensitivity function S yp 


for different PID controllers 
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Figure 3.10. Frequency characteristics of the modulus of the input sensitivity function S a 


for different PID controllers 
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The performance of a controller is enhanced by the augmentation of the attenuation 
band. But the augmentation of the attenuation band produces an increase of the 
amplification of the disturbances outside the attenuation band and an increase of 
Syp 
(it will be shown later in Section 3.6. that the surface of the attenuation band 
should be equal to the surface of the amplification band). 

One observes that for a specified @g = 0.25 rad/s the attenuation band is larger 


Syp 


the maximum of which will reduce the modulus margin and the delay margin 


than for@, =0.2 rad/s but the is beyond the acceptable value for the 


robustness (it crosses the template for Az =T, ). 

One also observes that the introduction of auxiliary poles is more or less 
equivalent to the reduction of the desired performances (the curve for 
@y = 0.2 rad/s is very close to the curve for @) = 0.25 rad/s and a, =a, = -0.15 ). 

However, if one examines the frequency characteristics of the modulus of the 
Sup 


input sensitivity function , one observes that the introduction of the auxiliary 


poles for the case @) =0.25rad/s has a better effect than the reduction of the 
desired performance without introduction of auxiliary poles. The auxiliary poles 
S 


allow reducing the value of in the high frequency region without affecting the 


up 
regulation performances (see the frequency characteristics of |s AE This means 


that a better robustness with respect to model uncertainties in high frequencies will 
be obtained together with a reduction of the actuator stress in high frequencies. 
In order to assure a good robustness at high frequencies and to reduce the 


actuator stress, it will be desirable to reduce 


Sal further in this frequency region, 


which implies a reduction of the controller gain at these frequencies. The 
introduction of auxiliary poles improves the situation but does not allow 
overcoming a fundamental limitation of PID controllers, namely the impossibility 
to obtain a very low gain at high frequencies. In order to achieve this it is necessary 
either to increase the order of S(q~/) (which will allow the introduction of a second- 
order filter instead of a first-order filter), or “to open the loop”, which implies the 
increase of the order of R(q~‘) in order to introduce zeros imposing a null gain of 
the controller at the frequency 0.5 f. The use of the pole placement, which do not 


impose any restrictions on the size of R(q~/) and S(q~/), will allow such a design. 
3.2.6 Digital PID Controller: Conclusions 


The discretization of the classical PID results in a digital controller with a 
canonical three-branched structure (RST) with 7(q~“) = R(q-/) (PID1). 

Based on the coefficient of R(q~) and S(q-/), the coefficients of a continuous- 
time PID may be computed if the polynomial 


Sq) =1+3s',q! 
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has s’,eE]-/,0]. 


The model based digital PID controller considered can deal with first-or second- 
order systems with time delay, if this latter is less than 7, (sampling period). 


For time delays rT > 0.25 T (time constant of the system of the plant), the 
continuous-time PID leads to responses that are slower in closed loop than the ones 
in open loop! 

For systems with time delay, the closed loop performances may be significantly 
improved by choosing coefficients of R, S, T that do not result in an equivalent 
continuous-time PID controller. 

The overshoots that may appear in closed loop can be eliminated by replacing 


T(q!)=R(q!) [PID1] with 7 (gq) =RU) [PID 2] 


Digital PID controller design can be carried on the basis of the discrete-time 
plant model and of the desired closed loop performances. 

Every PID design should be concluded by an analysis of the robustness margins 
and of the frequency response of the input sensitivity function at high frequencies. 


3.3 Pole Placement 


The computation of the digital PID controller parameters is a special case of the 
“pole placement” strategy. 

The pole placement strategy allows the design of a RST digital controller both 
for stable and unstable systems: 


e Without restriction on the degrees of the polynomials A(q~“) and Bq”) of 
the discrete-time plant model (provided that they do not have common 
factors) 

e Without restriction on the time delay 

e Without restriction on the plant zeros (stable or unstable) 


This method does not simplify the system zeros (this is why they can be unstable). 
The only restriction concerns the possible common factors of A(q~/) and B(q~/), 
which must be simplified before the computations are carried out. 


3.3.1 Structure 


The structure of the closed loop system is given in Figure 3.11. 
The plant to be controlled is characterized by the pulse transfer function 
(irreducible) 


q’ Bq) 


Mee ce 


(3.3.1) 
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in which d is the integer number of sampling periods contained in the time delay 
and 


A(q"')=1+a,q" tte g (3.3.2) 


Bq!) =b +bo9q? +...+b,,q ™ =q B (q) (3.3.3) 


Figure 3.11. Pole placement with RST controller 


The closed loop transfer function is given by 


q“T(q')B(q"') = q“ Tq Bq) (3.3.4) 


Hela y= 
“ ADS) +q BUDR) Pq”) 


in which 


Pg!) =A) Sr) + REIREI = 1+ pq! +p2q? ha 038) 


defines the closed loop poles that play an essential role for the regulation behavior. 
The behavior with respect to a disturbance is given by the output sensitivity 
function 


ADSG) _ Ag )Sq") (3.3.6) 


S „(q”)= 
wi = MAOS ET BORG) PG?) 


It can thus be seen that P(q~/) corresponds to the denominator of the output 
sensitivity function and, thereby, it defines for a large extent the regulation 
behavior. 
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3.3.2 Choice of the Closed Loop Poles Pa) 


We have seen for the case of a digital PID controller that one can specify a 
polynomial P(q-7) defining the closed loop poles on the basis of a second-order 
continuous-time system with the desired natural frequency and damping (see 
Section 3.2.2). One can also directly specify the polynomial P(q~/) from the 
desired performances. To illustrate the last statement, consider the following 
example. 

Let 


Pq!) =1+p,q! with p,=-0.5 
When there is no reference, the free output response is defined by 
VD) =- pı y() = 0.5 y) 


One thus obtains a relative decrease of 50% for the output amplitude at each 
sampling instant (see Figure 3.12). 


y (t+1) = 0,5 y (t) 


y(0) 
Figure 3.12. Responses for P(q7!) = 1-0.5 q`! 


Choosing p; between -0.2 and -0.8, it is clear that the disturbance rejection 
speed can be controlled. 

Nevertheless, generally speaking, P(q~“) is chosen in the form of a second-order 
polynomial by discretization of a second-order continuous time system, specifying 
@p, ¢ and assuring that the condition 


095 < T, S15 ; O72 esi 


is satisfied (see Section 3.2.2). 
The polynomial chosen from the desired closed loop performances will define 
the dominant closed loop poles and it will be named Pp(q~’). 


> The functions fd2pol.sci, omega_dmp.sci (Scilab) and fd2pol.m, omega_dmp.m (MATLAB®) can be 
used. 
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If it is desired to introduce a filtering action in certain frequency regions (or to 
reduce the effect of the noise on the measure, or to smooth the variations of the 
control signal, or to improve the robustness), the poles of the corresponding filter, 
defined by a polynomial P;(q~/), should also be the poles of the closed loop. As a 
consequence, the polynomial P(q-/) defining the desired closed loop poles will be 
the product of the polynomials Pp(q/) and P-(q~/) specifying dominant and 
auxiliary closed loop poles, respectively. 


P(g!) = Poq”) . Peg) (3.3.7) 
As a general rule, the poles named “auxiliary poles” are faster than the “dominant 


poles”. That is expressed, for the case of discrete-time models, by the property that 
the roots of P;(q”/) should have a real part smaller than the real part of the roots of 


Polg”). 
3.3.3 Regulation (Computation of R(q”)) and S(q"4)) 
Once P(q~/) is specified, in order to compute R(q/) and S(q~/) according to 


Equation 3.3.4 , the following equation, known as “Bezout identity” (equation), 
must be solved: 


AI Sq) + g! Bg!) RIG))= Pg) (3.3.8) 
Defining 
ng=degA(q!) ; npg=deg Bq!) (3.3.9) 


this polynomial equation has a unique solution with minimal degree (when (A(q~/) 
and B(q~“) do not have common factors) for 


np = deg P(q!) <ng+ngt+d-1; 


ng = deg S(q!) =ngpt+d-1 ; np=deg R(q!) =ng-1 (3.3.10) 
in which 

S(q"') =1+ sq +...+ Span =1+ q's’) (3.3.11) 

R) =r +g +. +r (3.3.12) 


In order to solve effectively Equation 3.3.8 , this latter is often put in the matrix 
form 


Mx=p (3.3.13) 
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in which 


X = [Sisata] (3.3.14) 


a9 np 


p” =[, Pi Pis Pn, 0-0] (3.3.15) 


and the matrix M has the following form 


npg +d na 
pu auauua 
1 0o 0 0 as = 0 
al 1 . b'i 
a2 0 b'2 b'ı 
1 b'2 na+ng+d 
al 
an, a2 b' Np 
0 0 ; 
0 0 an, 0 0 0 b'n, 
eh E a O e 
ngatngt+d 
where: 
by=0 for i=0,1.d  ; by =bjg for iz dtl 


The vector x, which contains the coefficients of the polynomials R(q/) and S(q 
1), is obtained, after the inversion of the matrix M, by the formula 


x=M” p (3.3.16) 


where Mis the matrix inverse of M. This inverse exists if the determinant of the 
matrix M is different from zero. One can prove that this is verified if, and only if, 
A(q}) and B(q“) are coprime polynomials (no simplifications between zeros and 
poles). 

Several methods are used to solve Equation 3.3.8. These methods give better 
numerical performances with respect to a simple matrix inversion. 

For different reasons the polynomials R(q~/) and S(q~/) may contain, in general, 
fixed parts specified before the resolution of Equation 3.3.8 . For example, if zero 
steady state error is required for a step on the reference, or for a step disturbance, 
the presence of an integrator in the open loop transfer function is required. This 
corresponds to the introduction of a term (/-q~“) in the polynomial S(q~“‘) (see 
Section 2.4). 
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In order to take into account these pre-specified fixed parts, the polynomials 
R(q°‘) and S(q~) are factorized in the form 


R(T”) = Rg) Hr (q1) (3.3.17) 
Sq) =S' (q) Hs (q9) (3.3.18) 


where Hp (q^) and Hs (q^) are pre-specified polynomials and 


R(q')= m+ ng! +... + P T (3.3.19) 


S= sg s (3.3.20) 


For this parameterization of polynomials R(q~“) and S(q-/), the closed loop transfer 
function will be 


q “T(q')B(q"') 
AQ )S'(q")Hs(q')+4q “Bq DRG ARG") (3.3.21) 
_ I TBA) 
Pq) 


Bald y= 


and, instead of Equation 3.3.8 , one needs to solve the equation 
A) Hs) Sr) + q1 BT) ARG) Rg!) = P(g) (3.3.22) 


In order to solve Equation 3.3.22, one needs to solve Equation 3.3.8 after 
replacing: A(q”) by Aq”) = A(T OHA”) and Big!) and B(g!) = gB’) 
H(q-') with the restriction that polynomials [4(q ^ H. ag? )] and [B(q 7) HRD] 
are coprime. 


The condition of Equation 3.3.10 on the orders of the polynomials that allow 
one to get a unique solution of minimal order, become in this case 


np = deg P(g!) Sngtny,+ngt+ny,td-1; 
ng = deg S(q)=ng + ny, + d—1; np =deg R'(q!)=n, + ny, =l (3.3.23) 


For the controller implementation, S(q/) will be given by STOH) and 


RC!) by Rq”) Hq"). 
Equation 3.3.22 or 3.3.8 can be solved by means of the functions bezoutd.sci 
(Scilab) and bezoutd.m (MATLAB") available on the book website. 
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Use of Fixed Parts of the Controller (Hp and Hy): Examples 


Steady-State Error 

As illustrated in the previous sections, S(q-/) must contain a term (/-q~/) in order to 
have a zero steady state error for a step input or disturbance (S\,, (q1) must be zero 
in steady state, i.e. for q = 1). Thus 


ADHS DS 


S „(q= (3.3.24 
pa) Pq") ) 

and then one needs to choose: 
Haq?) =]-q! (3.3.25) 


Rejection of a Sinusoidal Disturbance 

If a perfect rejection of a sinusoidal disturbance is required at a specified 
frequency, it isessential that S, (¢“) is zero at this frequency, which is equivalent 
to the requirement that Hq!) has a pair of undamped complex zeros at this 


frequency. 
In this case: 


Hy(q)= Ilt+agqi+q? (3.3.26) 


with æ =- 2 cos aT, =- 2 cos (2 m Ph). 
If one requires only a given attenuation, Hq") must introduce a pair of 


damped complex zeros with a damping factor depending on the desired 
attenuation. 


Signal Blocking 

In some applications the measured signal contains signal components at particular 
frequencies for which the controller should not react (these signals may serve for 
process technological operation). This implies that at these frequencies one should 
have S Ag =! . It results from Equation 3.3.24 and 3.3.6 that at these 
frequencies it is essential that Hq?) be null. As a consequence, the input 
sensitivity function Se ) must be null (no effect of the disturbance upon the 
control signal). 
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The expression of Sq ) is given by 


Aq HH RTR) 
P(q"') 


Sw) (3.3.27) 


and one must choose the fixed part R(q/) named H,(q™/) such that it has a null 


gain at this frequency. 
The fixed part of R(q~) will be of the form 


Aq") =] + Bq! + q? (3.3.28) 


where 8 = - 2 cos œ T; = - 2 cos (2 m f/ fi). 

This introduces a pair of undamped complex zeros at the frequency f or, more 
generally, in the form of a second order polynomial corresponding to a damped 
complex zeros pair, if a desired attenuation is accepted. 

In many applications it is required that the controller does not react to signals 
close to 0.5 f, (where the gain of the cascade actuator-plant is generally low). In 


this case one imposes: 


Hq) =(+pg)"  n=1,2 (3.3.29) 


with 0< 8 <1. 


Note that (J + £ q^)? corresponds to a damped second-order system with a 
resonant frequency equal to mf, (see Section 2.3.2): 


ali = 19, 


and the corresponding damping factor depends upon 2 through the relation 


For £= 1 it follows that ¢ = 0 and the closed loop system works in open loop at 
0.5 f, (even for n=/). 


Robustness 
In order to guarantee both robustness margins and specified closed loop 
performances, fixed parts H RAT ) and H Aq? ) (as well as auxiliary poles) should 
be introduced for shaping the frequency characteristics of the sensitivity functions 
Spr’) and STD in specified frequency regions. This will be discussed in 
Section 3.6. 
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3.3.4 Tracking (Computation of T(q"!)) 


Ideally, when the reference changes, it is desired that the system output y(t) follows 
a desired trajectory y(t). This trajectory may be stored or generated each time the 
reference is changed by using a reference model (as indicated in Figure 3.13). 

The transfer function of the reference model is 


E -ip -1 
H,,(q 1-4 Bald) (3.3.30) 
Anq) 
Ideal case 
y 
r 
desired trajectory ooo 


for y (t) 


Figure 3.13. Desired trajectory y*(t) generation 


It is generally determined from desired performances (rising time, overshoot, 
settling time). For example, a second-order normalized continuous-time model 
(parameters @p,, ¢) can be defined by means of the curves given in Figure 1.10 
starting from the desired performances. Once the continuous-time transfer function 
and the sampling period T, are known, the pulse transfer function of the reference 
model is obtained by discretization. 

The pulse transfer function of the reference model will be of the form 


GB (dq) bno + Om) 


(3.3.31) 
Ay, (q') l+a m +a mq” 


Hila” )= 


This is the transfer function that the controller must achieve between the reference 

r and the output y, eventually multiplied by g~ in the case of a time delay d in the 

plant model (the delay cannot be compensated). In the case of the pole placement 

this cannot be obtained because the plant zeros are maintained (polynomial B(q~/)). 
The objective is then to approach the delayed model reference trajectory 


q Bpa) 


3.3.32 
AG O a 


y (= 
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For this, firstly y"(t+d+J) is generated from r(#): 


ye a) (3.3.33) 


m 


Bi(q 
a 


wa J 


and one chooses 7(g~) to impose: 


° Unit static gain between y* and y 

° Compensation of the regulation dynamics defined by P(g~) (because the 
regulation dynamics is in general different from the tracking dynamics 
An") 


This leads to the choice 


Tq!) = G Pq) (3.3.34) 
where 
See ao (3.3.35) 
The control law equation becomes 
SAD ult) + Rg!) y(t) = Tig) y*(+a+1) 6.3.36) 


The full diagram for the pole placement is given in Figure 3.14. 


y (t+d+1) u(t) y(t) 
r(t) Bm T i 
“| a ig 

Am i 

| 

| 

| 

| 

| 


-d 
q B 


A 


> 


-(d+1) 


Cw) 


Læ 


P(q”’) 
qi) Ba) 
B(1) 

gg Ba) B*(q"') 


Ma — Ce 


A Aa") B(1) 


— > 


Figure 3.14. Pole placement - tracking and regulation 


The transfer function (operator) between the reference and the output will be 


qB) BAD (3.3.37) 
An(q") BO 


Ha(q”)= 
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In some cases one can consider a simplification of the polynomial T by taking into 
account just the dominant poles (as auxiliary poles are often at high frequencies 
with a small influence on the time response). In this case 


Bg!) BD PO 


(3.3.38) 
An (q') Bil) Pr (q') 


Halq") = 2 


and 
T(q') =GP (q`) (3.3.39) 


where 


P). 
gla if B(l)+0 
1 if BQ)=0 


If the regulation dynamics is the same as the tracking dynamics, there is no need 
for a reference model of the form of Equation 3.3.33 and the polynomial 7(q~/) is 
replaced by a gain®: 


PO: gaed 
rg )=G=4am ” 20* 
i if B()=0 


which guarantees a unit static gain between the reference trajectory and the output 
(if B(Z) is not null). 

The controller equations for the pole placement under different forms are 
summed up in Table 3.5 (the recursive equations needed for the implementation 
are boxed). 


6 Tf Sq’) contains an integrator (S(/)=0) it follows from Equation 3.3.21 that 
B(D)R(1) = PU) and P(/)/ B(1) = R(1), respectively. 
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3.3.5 Pole Placement: Examples 


Table 3.6 gives the results for a pole placement design. The considered example is 
the control of a plant model characterized by a second-order discrete-time model 
with two real poles (at 0.6 and 0.7) and an unstable zero. 

The tracking dynamics (polynomials A,,(q~“) and B,,(q~“)) has been obtained by 
discretization of a second-order normalized continuous-time model, with wg = 0.5 
rad/s and €= 0.9, (Tẹ =1s). The regulation dynamics (polynomials P(q~/)) has 
been obtained by discretization of a second-order normalized continuous-time 
model with @ = 0.4 rad/s and ¢ = 0.9. The controller includes an integrator. 
Satisfactory robustness margins are obtained. The performances are shown in 
Figure 3.15. 


Table 3.5. Pole placement - control law equations 


T(q')y (t+d+1)-RqQ') x) 
S(q') 


Sq u(t) + RYA = GP(q"!)y (t+ d +) =T(q"')y (t+d +1) 
S(q')=1+q'S (q"') 
u(t) = P(q7')Gy (t+ d +1)- S* (q ult -1)- RQ) yr) 


* B, (q` 
y*(t+d+)) EAC 
m q 


Anq =q AA 


y (t+d +1) =-An DYE + d) + Bp TNO 


u(t) = 


-1 -1 
Bnd ) = bing + Din +... 


- - -2 
Am(4q 'Y=1+aniq '+amq +... 


Exercise: 
What are the specifications for the “pole placement” technique that will lead to a 
PID 2 controller ? 
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Table 3.6. Pole placement results 


Plant: 

e d=0 

© Bg) =01¢1+02¢q7 

e Ag!) =1-13q! +0.42q7 
Tracking dynamics: 


e Bm qI) = 0.0927 + q! + 0.0687 q? 
© A, (qt) = 1-1.2451q! + 0.4066 q? 
e Ts= 1s , a9 =0.5 rad/s, C= 0.9 


Regulation dynamics > P q1) = ] - 1.3741 gi + 0.4867 q? 
Ts = 1s , œQ = 0.4 rad/s, ¢= 0.9 


Pre-specifications: Integrator 


*** CONTROL LAW *** 


S (TD ut) +RG) yO =T) y Cat) 


y EAH) = BG AT rÀ 
Controller: 
© R@t) =3-3.94g1+13141q2 
© Sq!) =1- 0.3742 ¢! - 0.6258 q? 
© Tq) = 3.333 - 4.5806 q1 + 1.6225 q? 


Gain margin: 2.703 Phase margin: 65.4 deg 
Modulus margin: 0.618 (- 4.19 dB) Delay margin: 2.1 s 


3.4 Tracking and Regulation with Independent Objectives 


This controller design method makes it possible to obtain the desired tracking 
behavior (changing of reference) independently of the desired regulation behavior 
(rejection of a disturbance). For example, the performance specifications illustrated 
in Figure 3.16 correspond to a situation for which the desired regulation response 
time (for a step disturbance) is significantly smaller than the desired tracking 
response time (for a step reference). Note that the reverse situation may be 
encountered. This method is a generalization of the so-called “model reference 
control”. 
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Plant Output 


Figure 3.15. Pole placement performances 


Unlike the “pole placement” method (Section 3.3), this method leads to the 
simplification of the zeros of the discrete-time plant model. This enables the 
tracking and regulation performances to be achieved without approximation. 

This control strategy permits a RST digital controller to be designed for both 
stable and unstable systems: 


e Without restriction on the degrees of the polynomials A(q~/) and B(q-/) 
characterizing the pulse transfer function of the plant 
e Without restriction on the time delay d of the system 


As a result of the simplification of the zeros, however, this strategy can only be 
applied to discrete time models with stable zeros. 

This method cannot be applied to systems with fractional delay greater than 
0.5T,. In the case of a fractional delay greater than 0.5T,, however, one can 


consider approximating (in the identification phase) the model with a fractional 
delay by a model with an augmented integer delay. 

Note that unstable zeros can be the consequence of a too fast sampling of 
continuous time systems characterized by a difference greater than 2 between the 
numerator and denominator degree of the continuous time transfer function (even 
if the continuous time zeros are stable) (Astrém and Wittenmark 1997). 

This method can be considered as a particular case of the “pole placement” 
method. This equivalence can be obtained by imposing that the closed loop poles 
contain the zeros of the discrete time plant model (defined by the polynomial 
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B*(q'!)). This is the reason for which the zeros of the plant model must be stable 
(see Section 3.4.2)’. 


tracking regulation 


{ 


output 


reference 


=t 


Figure 3.16. Tracking and regulation performances 


Zero Admissible Zone 


Imag Axis 


Real Axis 


Figure 3.17. Admissible domain (hatching zone) for the zeros of the discrete-time plant 
model (tracking and regulation with independent objectives) 


7 An approximation of the tracking and regulation with independent objectives, for the case of unstable 
zeros, can be obtained by pole placement, where the unstable zeros, which should be specified as closed 
loop poles, are approximated by stable zeros. This technique is presented in the stochastic context in 
Section 4.3. 
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It is convenient then to verify that, before the application of this method, the 
zeros of B (q`?) are stable, and, moreover, that complex zeros have a sufficiently 
high damping factor (¢ > 0.2). In other words, the zeros should lie inside a region 


defined by the cardioids related to the constant damping factor ¢ =0.2 (see Figure 
2.21). This admissibility domain is shown in Figure 3.17. 


3.4.1 Structure 


The structure of the closed loop system is presented in Figure 3.18. 


y (t+d+1) u(t) y(t) 


qa) Bala) 
An(a”) 


Figure 3.18. Tracking and regulation with independent objectives 


The closed loop poles are defined by the polynomial P(q-/) that almost 
completely specifies the desired behavior for the regulation. 
As a general rule, P(q~) is the product of the two polynomials 


PG!) = Poq”) . Pg) 


where Pp(q~/) is determined as a function of the desired performances and P;(q~/) 


represents the auxiliary poles (for more details see Section 3.3.2). 
The desired transfer function between the reference r(f) and the plant output 
y(t), which defines the tracking dynamics, is 


gra et Aa) 


The output of the tracking model B,,(q/) / A,,(q/) specifies the desired trajectory 
y* with d+/ steps ahead. 

The plant to be controlled is characterized by the pulse transfer function given 
in Equation 3.3.1, where the polynomials A(q/) and B(q~!) are specified by 
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Equations 3.3.2 and 3.3.3. Note that in this case polynomials A(q~/) and B(g~/) can 
have common factors. 

The computation of R(q~/), S(q“), T(q-/) is done in two stages. First, by means 
of polynomials R(q~/) and S(q~/), the closed loop poles will be placed at the desired 
values specified by the polynomial P(g~/), and the zeros of the discrete-time plant 
model will be simplified. Second, the pre-filter 7(q~/) is computed in order to 
obtain the tracking of the reference trajectory y", delayed by d steps. Note that for 
P(g’) = 1 this method corresponds to the “model reference control”. 


3.4.2 Regulation (Computation of R(q!) and S(q"})) 


Without the pre-filter 7(q~/), the closed loop transfer function is: 


Halg )= =I 4 ae AC ) =I = = A ~ 
Aq” SA +g BORA) Pq) (3.4.1) 
ae Cas 
B(q')Pq") 


The closed loop poles should be those defined by P(q-/) and the system zeros 
should be cancelled (in order to obtain a perfect tracking at a later stage). 

From Equation 3.4.1, it results that the closed loop poles must contain in 
addition the zeros of the plant model. 

Once P(q~/) is specified, it results from Equation 3.4.1 that, in order to compute 
R(q°‘) and S(q-), the following equation must be solved: 


Ag) Sq) + OY BY) Rg!) = Bg) P(g) (3.4.2) 


Equation 3.4.2 corresponds to the pole placement with a particular choice of the 
desired closed loop poles (that contain ng-/ additional poles corresponding to the 
plant zeros). 

However, in order to solve Equation 3.4.2, one observes that S(q~/) should have 
B*(q‘) as a common factor: 


Sq") = so tg) +s, g” =B (GS) (3.4.3) 


Introducing the expression of S(q-/) given by Equation 3.4.3 in Equation 3.4.2, and 
after simplification by B*(q~/), one obtains 


A(q!) Si) + g+ Rig) = P(g!) (3.4.4) 


This polynomial equation has a unique solution for 
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np =degP(q!) = ngtd ; deg Sq!) =d; deg R(q') =ng-l (3.4.5) 
in which 

RA =r tng +0419 4" (3.4.6) 
and 

Sq) =1+s qit.ts¢4 (3.4.7) 


Equation 3.4.4 corresponds, under the conditions of Equation 3.4.5, to the matrix 
equation 


Mx=p (3.4.8) 


where M is a lower triangular matrix of dimension (n ,+d+J) x (ng+d+1) 


ne mee 
1 
ay 1 9 
a2 al 0 
: : 1 
ad ad. a 1l 
+d+ 
ad+ı ad ay aor 
ad+2 ad+1 a2 
0 
0 0 zs 0 a, 0 1 
d+] ny 
x) = [1 8} E a oes %y-1 1 (3.4.9) 
p” =[1, Pi, Pass Pn, »Pa +i Pn +d] (3.4.10) 


Some coefficients p; can be zero. Since M is a lower triangular matrix, Equation 
3.4.8 (and respectively Equation 3.4.4) always has a solution. 
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In order to solve Equation 3.4.4 one can use predisol.sci (Scilab) and 
predisol.m (MATLAB") functions available on the book website. 

One observes that, because of the nature of the design methodology, S(q-/) 
already contains a fixed part (Equation 3.4.3) specified before solving Equation 
3.4.4. 

Thus, it is convenient to consider, as in the pole placement case, a 
parameterization of S(q“) and R(q”/) in the form 


R(q!) = Hr (q9) Rq”) (3.4.11) 
SI) = Hs (qY) Sq) (3.4.12) 


In which Hp(q-!) and Hs(q-/) represent the pre-specified parts of R(q-/) and S(q-/). 
In the case of tracking and regulation with independent objectives, Hs(q~/) will 
have the form 


As(q"') = B*(q!). H's(q") (3.4.13) 


and Equation 3.4.4, in the general case, becomes 

Ag) H's) Sq) + OY HRA) Rg!) = P(g") (3.4.14) 
For solving 3.4.14 one can also use predisol.sci (Scilab) and predisol.m 
(MATLAB") functions. Note also that pole placement equations can be used for 
computing S’(q“) and R’(q-!) by introducing B*(q-/) in the expression of P(q-/). 
Steady-State Error 
In order to have a zero steady state error for a step input or a step disturbance, the 


open loop cascade must contain a digital integrator, i.e. the polynomial S(q-/) must 
contain a term (/-q~/): 


Sq) = Bg) (1 - g”) S (D= B) Hq) Si) (3.4.15) 


Introducing this expression in Equation 3.4.2 and after simplification by B*(q~/) 
one gets 


Ag) (1-¢) Sq) + gO Rig!) = PA) (3.4.16) 


which must be solved in order to obtain the corresponding coefficients of Sq) 
and R(q~/) when an integrator is used. 
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3.4.3 Tracking (Computation of T(q”!)) 


The pre-filter 7(q-/) is computed in order to achieve (in accordance with Figure 
3.17), between reference 7(t) and (4), a transfer function: 


HN Be) Be Ie a nae 
AC] ) = =j a ( me ) 
An(q) An(q )P(q) 
From Equation 3.4.17 
Tq!) = P(g“) (3.4.18) 


The input of 7(q/) is the (d+J) steps ahead prediction of the desired trajectory 
y"(tt+d+1), obtained by filtering r(A with the tracking model BAG?) / Aq?! ). 


i AC) 


and the controller equation will be given by 
S(q!) u(t) + RI yW) = P(g!) y*(t+d+1) (3.4.20) 


Equation 3.4.20 may also take the form 


P(q"')y (t+d +1)- RYA) 


u(t) = - (3.4.21) 
Sq") 
Since S(q-/) is of the form 
Sq) = sotsi +.. +s, qg = soq S (qu 
(4 )=so +519 3 otg S (q ) 6.422) 


=B (qS) 
and considering the expressions of B*(q~/) and Sq! ) (given by Equation 3.4.7): 
Sg=b, (3.4.23) 


Therefore Equation 3.4.20 may also take the form® 


8 One can also normalize the parameters of the controller by dividing all parameters by Sq = bz. This 


avoids a multiplication operation in real time implementation. 
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u(t) = Pane +d+1)-S* (qult -D-R DIO) 68424 
1 


As for the pole placement case, if the desired dynamics is the same both for 
tracking and regulation, the reference model is no longer necessary and the 
polynomial 7(q~“) is replaced by a simple gain to guarantee unit static gain 
between the reference trajectory and the output: 


Tq”) =G = FP) 
If S(q~/) contains an integrator, then the polynomial T(q/) becomes 


nq!) =G = RW) 


3.4.4 Tracking and Regulation with Independent Objectives: Examples 


Table 3.7 gives the results of the design for tracking and regulation with 
independent objectives. 


The example considered here concerns the control of a plant characterized by a 
second-order discrete-time model with two poles at z = 0.6 and at z = 0.7, and with 
a stable zero. The desired tracking dynamics (polynomials Am (q/) and Bm (q2) 
has been obtained by discretization of a second-order normalized continuous-time 
model with wg = 0.5 rad/s and ¢ = 0.9 (T, = 1s). The desired regulation dynamics 


(polynomial P(q~/)) has been obtained by discretization of a second-order 
normalized continuous-time model with @ = 0.4 rad/s and ¢ = 0.9. The controller 


contains an integrator. The computed values of R(q“) and S(q~/) are given in the 
lower part of Table 3.3, and the simulation results, for a reference tracking and a 
load disturbance (step) on the output, are presented in Figure 3.19. Note that the 
position of the zero is close to the boundaries of the admissibility domain (zg = - 
0.5 corresponds to ¢ = 0.2), and this explains the damped oscillations observed on 
the control signal when a step disturbance occurs. 

Table 3.8 gives the computed values of the controller parameters for a plant 
having the same dynamics of the previous one but with a time delay d = 3 (instead 
of d = 0). All the desired performances have been maintained. Polynomial S(q~/) 
has a higher order. Closed loop system responses are presented in Figure 3.20. One 
observes that the output response is the same as in the case of d = 0 (Figure 3.20) 
except that they are shifted by d steps. Moreover, by comparing Figures 3.19 and 
3.20, one observes that the control signal is the same. In other words, even if the 
same output value is recovered with a delay of three sampling periods, the 
controller computes a signal that is the same as in the case of d = 0. In fact, for the 
case with time delay, the controller contains a three step ahead predictor (for 
details see Appendix B). 
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Table 3.7. Tracking and regulation with independent objectives (d=0) 


Plant: 
e d=0 
© Bg) =0.2¢1+01¢q7 
e Ag!) =1-13¢! +0427? 
Tracking dynamics: 
© By (gt) = 0.0927¢q1+ 0.0687 q? 
© A, (qt) = 1-1.2451g 1+ 0.4066 q? 
e T,=1s, a9 =0.5 rad/s, = 0.9 
Regulation dynamics > P q1) = ] - 1.3741 gq! + 0.4867 q2 
Ts = 1s , a9 = 0.4 rad/s, ¢= 0.9 


Pre-specifications: Integrator 


** CONTROL LAW *** 
Sq) uÀ +R (G) WH =T} y t+d+1 
GT )uOt RAVATA )y t ) 


yi(ttdtl) = [By (T WAm GD). rO 
Controller: 
© Rg!) = 0.9258 - 1.2332 g1 + 0.42 q? 
© Sq!) =0.2-0.1q1-0.1q? 
© Tg) =P!) 
Gain margin: 2.109 Phase margin: 65.3 deg 
Modulus margin: 0.526 (- 5.58 dB) Delay margin: 1.2 s 


One observes that the delay margin is smaller than one sampling period. In this 
case, one should specify high frequency auxiliary poles in P(q~/) that lightly affect 
the low frequency behavior but improve the robustness at high frequencies (in 
particular the delay margin). 

The maximum number of closed loop poles (the maximum degree of 
polynomial P(q~/)) is 5. Having already specified a pair of dominant poles, one can 
impose, for example, P(g!) = (J — 0.1 q% . In this case, one obtains a gain 
margin of 2.157, a modulus margin of 0.534 (-5.45dB), a phase margin of 58.5 
degrees and a delay margin of 1.19s (greater than one sampling period). 

The closed loop system responses are presented in Figure 3.21. Tracking 
performances are the same as for the case without auxiliary pole, and regulation 
performances are almost unchanged. One also remarks that the introduction of 
these poles reduces the stress on the actuator in the transient for the disturbance 
rejection. 
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Table 3.8. Tracking and regulation with independent objectives (d=3) 


Plant: 
e d=3 
© Bg!) =0.2¢1+0.1q7 
© Ag!) =1-1.3 q1+ 0.42 q2 
Tracking dynamics: 
© Bpm (gt) = 0.0927 + 0.0687 q1 
© Am(q4) =1-1.2451q4 + 0.4066 q? 
e T, =Is , ag = 0.5 rad/s, C= 0.9 
Regulation dynamics > P q1) =] -1.3741 q! + 0.4867 q? 
Ts = 1s , o9 = 0.4 rad/s, €= 0.9 


Pre-specifications: Integrator 


** CONTROL LAW *** 
SG) ul) + RG) yO =T) y +d 
(yun +R VAT )y Crd+1) 


y (ttd+1) = [By (G!VAm (TD 1 ref) 
Controller: 


© Rg!) = 0.8914 - 1.1521 q} + 0.3732 q2 
e Sq!) = 0.2 +0.0852 q1 - 0.0134 q? - 0.0045 q’ - 0.1785 q4 


- 0.0888 q3 
© Tq!) = Pg!) 
Gain margin : 2.078 Phase margin: 58 deg 


Modulus margin: 0.518 (- 5.71 dB) Delay margin: 0.7 s 


As a general rule, when the plant has a time delay, one needs to specify not only 
the dominant poles of P(q~/), but also auxiliary poles at values other than 0 in order 
to improve the robustness with respect to the possible variation of the delay (this 
remark is also valid for the other methods presented in this chapter). 
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Figure 3.19. Performances of tracking and regulation with independent objectives (d 
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Figure 3.20. Performances of tracking and regulation with independent objectives in 


=3) 


presence of a time delay (d 
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3.5 Internal Model Control (Tracking and Regulation) 


The internal model control (IMC) strategy (not to be confused with the internal 
model principle) is a particular case of the pole placement technique. In the internal 
mode control the poles of the plant model are chosen as the desired dominant poles 
of the closed loop. As a consequence, the closed loop system will not be faster than 
the open loop system. Since there will not be an acceleration of the closed loop 
time response with respect to the open loop time response, one can expect a better 
closed loop robustness with respect to plant model uncertainties. As the closed 
loop poles include the poles of the plant model, this technique can be applied only 
to stable and well damped discrete time plant models. This technique is often used 
for the control of stable plants with a large time delay with respect to the open loop 
rise time (the rise time does not include the time delay!). 

The control structure is the same as for the pole placement (Figure 3.14). 


Plant Output 


Time (UT) 


Control Signal 
T 


Time (tT) 


Figure 3.21. Performances of tracking and regulation with independent objectives with 
auxiliary poles in presence of a pure time delay (d = 3) 


3.5.1 Regulation 


In the case of the internal model control Equation 3.3.22 of the pole placement 
becomes 


A(q”')S(q')+q°-“ Bq RQ") = Aq") Peg) =P(q') 8.5.1) 
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Often in practice one selects 


Pz(q7') = ( +aq™ ye (3.5.2) 
or 


P; (q`) = +a +a" i (3.5.3) 


By examining the structure of Equation 3.5.1 one observes that R(q~) should have 
as a factor A(q~): 


RG) = Aq Rq) (3.5.4) 
and Equation 3.5.1, after elimination of the common factor A(q~/), becomes 
= ~d E E = R =j 
Sq )+q “Bl Rq )=Prlq ) (3.5.5) 


which presents similarities with Equation 3.4.4 for tracking and regulation with 
independent objectives (by replacing in Equation 3.4.4 S'by R', Aby g“B, 
gq “OR by S and P(q') by Pr (q_')). Equation 3.5.5 has a unique minimal 
order solution for 


np, = deg Pp (q7) <ng+d 


ng =degS(q')=ng+d_ ; ng =degR'(q"')=0 


The solution of Equation 3.5.5 becomes simpler if one considers the typical case 
where an integrator is introduced in the controller, i.e.: 


sq)=(-a"s'@") 3.5.6) 
In this case, for g=/ Equation 3.5.5 becomes 

BORD) = P; (I) (3.5.7) 
since S(/)=0 and one obtains 


Pr) 


R(q')=R'\(= 20 


(3.5.8) 
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and 
ay Pe) 
Rq )= A ay (3.5.9) 
S(q7)=0-q7)s'(q7) = Pra- Bg yee (3.5.10) 


From Equation 3.5.9 it follows that in this design the poles of the plant model 
(defined by A(g~/)) will be simplified by the zeros introduced by the controller. 
This implies that the poles of the plant model should be stable (see Chapter 2, 
Section 2.5.2). 

One interesting aspect of this design is the possibility to characterize the set of 


all the controllers as a function of P(q™!) without having to solve a polynomial 
equation. 


If, in addition to the integrator, a fixed part Hr(q~/) is imposed in R(q~), S(q-/) 
has the structure given in Equation 3.5.6 and R(q~/) will have the structure 


Rq) =A H RRG) 6.5.11) 
Equation 3.5.5 becomes 

S(q')+q “BQ ARQ RQ") = Prl) (3.5.12) 
with the condition 

Pr(l) = BO)ARMR'() (3.5.13) 
from which one obtains 


Pr) 


R(q")=R'()= 3.5.14 
(q')=R') RHO) (3.5.14) 
ty E a, PrO 

R(q )=Alq )Hrlq 30,0 (3.5.15) 

S(q') = Pp (q) -q BH RRG) (3.5.16) 


3.5.2 Tracking 


In the case of internal model control the polynomial 7(q~/) used for tracking is 
given by (like in the pole placement) 
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T(q')= A(q')Pp(q7')/ BO) (3.5.17) 


But if one chooses the same dynamics for tracking and regulation, the tracking 
reference model can be eliminated and 7(q~/) will be given by 


AMP (1) 


Tq”) =T) = ai 


(3.5.18) 


which guarantees a unit steady state gain between the desired tracking trajectory 
and the controlled output. 


3.5.3 An Interpretation of the Internal Model Control 


Let us consider first the case Hr(q“/)=/. The control law equation (Table 3.5) is 
written using the expressions of R, S, T given by Equations 3.5.9, 3.5.10 and 
3.5.17: 


Su jas free") z ZO gisan o = 


Bil) 
bi (3.5.19) 
1 E iy _ Pr -1 
l“ )Pr(q )y (t+d+1) BO Alq vol 
which can be re-written as 
P UO = 5 Ag Peg +d- 
(3.5.20) 
PDT < 7 E 
tia Dyf -q B uA] 


Taking into account that by hypothesis A(q~/) is asymptotically stable one obtains 
7 E 1 7 as 
NA MOP WO =F AG Pela Wy G+ d+) 


Pr (1) 
BA) 


-d -1 
4) 0 4 ics Luo) = 6.5.21) 


dnra 
T)(q7)y"(¢-+d +1) ETHES uo 


where 
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Pr (1) 
BO) 


So(q™) = Pp (q) 


Tae aa Pq") = a Aq")Pr(q") 


Ro(q')= A(q"') 


This leads to the equivalent representation of the closed loop behavior shown in 
Figure 3.22. 


y*(t+d+1) u(t) y(t) 


Figure 3.22. Equivalent diagram of the internal model control 


One can see that an equivalent implementation of the RST controller can be 
considered. This implementation explicitly features the model of the plant 
(prediction model) as a component of the control scheme. It is the error signal 
between the plant output y(f) and the predictor output (t), which is fed-back. 
Note also that the computation of Rọ and Sọ does not require the solution of a 
polynomial equation. 

For the case of Hp(q-!) + J, using Equations 3.5.14, 3.5.15, 3.5.16 and 3.5.17 
one obtains a similar result. Only the expression of Ro(q-/) changes (it will contain 
in addition the factor HR Y/ Hg(1)). 


3.5.4 The Sensitivity Functions 
In the case of internal model control the sensitivity functions have a particular 


structure, as a consequence of the choice for the dominant poles of the closed loop 
(they are equal to the plant model poles): 


SE’) _ _Z BE ARE P 
Pe(z™) BOHR (Pr (2) 


Se y= (3.5.22) 
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_ 2 *BE RE) 2 4 BE) Age DP) 


Si,(z") — (3.5.23) 
j A(z)P, (27) B()Hg()P-(z) 
z Riz") A(z) H(z) P0) 
S42) R a (3.5.24) 
7 Pe(z') BO) Ha (1) Pe(z") 
-d =] =j -d -1 
Sw(z")=-= oS 1 Ba (3.5.25) 


A(z) Pp (z~) A(z) 


Equation 3.5.25 clearly indicates that the plant model should be asymptotically 
stable in open loop. One can also see the direct influence of the transfer function 


HRG VPRED (i.e. the choice of Hg and Pp) upon the sensitivity functions. 
3.5.5 Partial Internal Model Control (Tracking and Regulation) 


In many applications the plant model is characterized by low frequency dominant 
poles (located within or close to the desired attenuation band) and secondary poles 
located outside the desired attenuation band. 

If the dominant poles are too slow, or if they have a too low damping (often the 
case for mechanical systems), the internal model control cannot be applied as such. 

In this case one uses a mixture of pole placement and internal model control. 
The pole placement will be used to assign the desired dominant poles of the closed 
loop but it will not move the secondary poles of the plant model (which will 
become poles of the closed loop). 


Suppose Aq’) has the form 


A(q') = A (qA aq) (3.5.26) 


where A,(q”) defines the dominant poles of the plant model. In the case of partial 
internal model control, the equation defining the closed loop poles will be 


Alq DA DSA) +9“ BARG") 


d d P (3.5.27) 
=Pp(q4 )A4l(q )Pr(q_ ) 


Examining the structure of Equation 3.5.27 it is seen that R(q`^) will be of the form 
R(q™) = A (q HR") (3.5.28) 


and Equation 3.5.27 (after elimination of the common factor A(q ^) becomes 
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Aq Sq +q BRG) = Pp (q™')Pe(q"') (3.5.29) 


This technique can also be interpreted as a simplification of the plant model 
secondary poles (defined by A AT) by the zeros of the controller. 


3.5.6 Internal Model Control for Plant Models with Stable Zeros 
If Bq’) has all its zeros inside the unit circle (and these zeros are sufficiently 


damped) one can use the tracking and regulation with independent objectives 
design but using as desired poles the dominant poles of the plant model. 


One considers that sq’) has the structure given by Equation 3.4.15 (presence 


of an integrator) and one supposes Hpq')=1 (in order to simplify the 
presentation). 
Equation 3.4.16 becomes 


Ag) (L-g) Sq’) + DRAGI) = Aq") Pra”) (3.5.30) 


This implies that R(q”) will have the form 


RGDA RG") (3.5.31) 


and Equation 3.5.30 becomes 

(L-g) SQ) + gD RQ) = Pra’) (3.5.32) 
For g=/one has 

RD) = R(q!) = Pr) (3.5.33) 
It results that 

(1-0) Sq!) = Peg) - 4) Pp) (3.5.34) 


from which one gets 


SA”) =B") [Pra -g Pr] (3.5.35) 


Rq’ = Aq’) PA) (3.5.36) 
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3.5.7 Example: Control of Systems with Time Delay 


Internal model control is often used for the control of systems with large time delay 
compared to the rise time of the system without time delay. If d > tr (where fp is 
expressed in sampling periods), the reduction of the rise time in closed loop does 
not produce a significant improvement of the total response time, since this is 
mainly determined by d. Therefore, one is able to use internal model control. 
However, even when one takes Ppr(q')=A(q’), the introduction of the auxiliary 
poles and/or of the fixed part H aq’) is necessary in order to assure the robustness 
of the closed loop with respect to the time delay variations. 

Consider the case Pr (q”)=1, Hr (q')=1 and B(q’)= biq” (b)>0). From 
Equations 3.5.22 and 3.5.23 one gets 


=j -d-1 =Í =T te -d 

Sp(z )=1-z =(l-z )(l+z +z^+..+z“) (3.5.37) 
Spe) (3.5.38) 

Syz” has a zeroat z=1 (@=0) and d zeros on the unit circle if d is even, or 


d-1 zeros on the unit circle plus a zero at z=-1 (@=7m) if d is odd. From 
Equation 3.5.37, since | get is always equal to /, it results that 


<2 (3.5.39) 


max 


Is, p(e%) 


and then the modulus margin AM =0.5 is always achieved. 
However 


Sy (e? ) 


=1 fr 0<@< zm (3.5.40) 


and therefore the frequency characteristic of | S,,| will cross the template for 
Ar =T, (see Figure 2.39: | S| should be smaller than / starting from f = 0.17f,). 


The condition for satisfying the delay margin in Figure 2.39 is in this case 


(3.5.41) 


and clearly this will not be satisfied at all frequencies. 
We will examine next the beneficial effect of the introduction of the auxiliary 


poles Pq’) and of a fixed part Ci in the controller. 


Auxiliary Poles (PAT) 4 I, HRT’) =) 
Let us select: 
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Peq) = +a q) -l<a<0 (3.5.42) 


and search for the value of @ assuring the delay margin Az = 7. . In this case S,, is 
given by Equation 3.5.23 and the condition for the delay margin Ar =T, takes the 


form 


m: a 
PpO 1 


J : z=e!® 0<@<a (3.5.43) 
Pe(z") | h-z” 


d Z 
E | E 
which for Pq") given by Equation 3.5.42 becomes 


l 
a 


l+a 


z=e!? 0<@<a (3.5.44) 


l+az! 


Replacing z by z=e/“one observes that the worst situation occurs at 
@=T (i.e. f=0.5f;) where 3.5.44 becomes: 


a) Syb Magnitude Frequency Responses 
Mnene, T T 


a 
D 
2 
v 
D 
5 
2 
= 
D 
f] 
= 
Frequency (fff) 
b) Syp Magnitude Frequency Responses 
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Figure 3.23a,b. Auxiliary poles effect on the delay margin: a noise- input sensitivity 
function (Syb); b output sensitivity function (Syp) 
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l+a 


i <05 DB as-0.333 (3.5.45) 
-4 


Figure 3.23a,b shows the frequency characteristics of |S\,| and |Syp| (controller with 
integrator) for a plant model characterized by d=7, B(q™)=q" (b,=1), 
Aq ')=1 +aq" with a, =-—0.2 and for three values of a: a=-0.1; a=-0.3; 
a=-0.333. For a@=-0.1 and qa@=-03 one gets the delay margin 
Ar =0.52T, and Ar =0.917, , respectively, and the corresponding curves of Sy, and 
Syp intersect the robustness template for Ar =T . For a=-0.333 the effective 
delay margin is Ar=7. and it can be seen that the corresponding sensitivity 
functions do not cross the robustness template for the delay margin Ar=T.. 


If one uses auxiliary poles Pz") of the form Equation 3.5.3: 
n, -l 
Pq) =(0+aq tag’) ™ 


one selects -1< æ < 0 and -0.25 < æ' < -0.05 with np, Sng +d . In this case one 


introduces np -1 high frequency auxiliary poles. This choice leads to a further 


contraction of S,, around 0 dB in the high frequency region, and a reduced effect 
upon the reduction of the performance at low frequencies. 

Figures 3.24a,b shows the frequency characteristics of the modulus of the 
sensitivity functions Syp and Syp for the same plant model, using either an auxiliary 
pole of the form of Equation 3.5.42 with q@=-05 or auxiliary poles of the form of 
Equation 3.5.3, with œ =—0.3, a’ =—-0.1, np, -1=7. The corresponding delay 


margins are 2.09T, and 2./4T;, respectively. The second solution is much more 
efficient for attenuating the sensitivity functions at high frequencies (improving the 
robustness and reducing the stress on the actuator). 


Introduction of Haq’) (PH(q')= 1, Hr(q') + 1) 
In this case, from Equations 3.5.14 and 3.5.15 one has: 


Rq')= Aq Hgg )R(q') (3.5.46) 
with 
H,(q'')=1+ fq"! (3.5.47) 


which leads to 
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1 


R(q')=——— (3.5.48) 


BOA + 2) 


and (using Equation 3.5.16 ): 


S(q")=1 


q “Bq U+ fq) (3.5.49) 
B+ £) 


For B(q!) = bq one gets 


2 (+Æ!) 


-1 
Saz )=- ET, (3.5.50) 
and the condition for getting a delay margin Ar =T, becomes 
=i 
a < l z=e!° OSØ@<S<T (3.5.51) 
1+2 h-z 
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Figure 3.24a,b. Effect of high frequency auxiliary poles on the sensitivity functions of plant 


models with time delay: a noise- input sensitivity function (Syb); b output sensitivity 


function (Syp) 
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The worst situation occurs at @ = 2/2 (f=0.25f;) where the condition of Equation 
3.5.51 becomes (replacing < by <) 


aE 2955 > =i (3.5.52) 
(1+ £) 


Therefore one should choose in this case 
Ha(q')=l+q"' (3.5.53) 


in order to assure a delay margin of (almost) one sampling period. 
It is interesting to note that Equation 3.5.53 corresponds to the opening of the 


closed loop at 0.5f; (see Section 3.3). This solution leads to Sup = 0 at f= 0.5fs and 
therefore a significant increase of the robustness at high frequencies. Figure 


3.25a,b presents comparatively the frequency characteristics of the modulus of Sy, 
and Sy, for the cases: 1)H,(q")=1+q", Pp(q™)=1 and 2)H,(q"')=1, 
Pp (q) =1-0.333z™. 


Of course one can use simultaneously P, (q) #1 and H idee’) +1. 
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Figure 3.25a,b. Effect of the fixed part Hp(q~')=1+q7'on the sensitivity function of a 


plant model with time delay: a noise- input sensitivity function (Syb); b output sensitivity 
function (Syp) 
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3.6 Pole Placement with Sensitivity Function Shaping 


In many applications, in order to satisfy simultaneously the imposed performance 
in regulation and the robustness margins, one is obliged to shape the modulus of 
the output and input sensitivity functions in the frequency domain. The shaping of 
the sensitivity functions is done by the appropriate selection of the desired closed 
loop poles and the introduction of pre-specified filters in the controllers. 

The modulus of the output sensitivity function |S (z/)|? is a significant 
indicator of both disturbance rejection properties and robustness properties of the 
closed loop (see Chapter 2, Section 2.6). 


The modulus of the input sensitivity functions |S, (z“)| is an indicator of the 
actuator stress in various frequency regions as well as an indicator of the tolerance 
to the additive uncertainties upon the plant model (see Chapter 2, Section 2.6). 

Using a digital RST controller, the output sensitivity function has the 
expression 


Sip(2") = sag Oy men 
and the input sensitivity function has the expression 

SpE) Se oe) 
where 

REL) = Hp(z!) R'E) (3.6.3) 

Sz) = H(z) Sz!) (3.6.4) 
and 

A(z!) Sz) +24 Bl) RED = Ppl(z!). Pz!) = P(r!) (3.6.5) 


In Equations 3.6.3 and 3.6.4, Hg(z 7) and H(z”) correspond to pre-specified fixed 
filters incorporated in R(z/) and S(z/) respectively. S(z/) and R(z/) (more 
precisely R(z/) and S"(z/)) are the solutions of Equation 3.6.5 where the 
polynomial P(z~/) defines the desired closed loop poles. The polynomial P(z~/) is 
factorized in order to emphasize the dominant poles defined by Pre ) and the 


auxiliary poles defined by P Ag! ). 


? In this section the notation “z” (complex variable) will be used instead of “q” when we will examine 
the properties of the various transfer functions in the frequency domain. 
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In what follows we will examine the properties of the sensitivity functions in 
the frequency domain (q = z = e”? ,@ =27 f/f,). 

The various properties of the sensitivity functions will be illustrated by means 
of the following example (T, =/s). 


Plant model: 


A(q!) =1-0.7 q1, Bq!) = 0.3 ql, d=2. 


Specified performance (polynomial P(q"!)): 
Defined by the discretization of a continuous time second-order system with 


e @ = 0.4 or 0.6 or l rad/s 
e ¢=0.9 (constant) 


3.6.1 Properties of the Output Sensitivity Function 


Property 1 
The modulus of the output sensitivity function at a certain frequency gives the 
amplification or the attenuation of the disturbance. 


At the frequencies where |Syp(@)| = / (0 dB), there is neither amplification nor 
attenuation of the disturbance (operation like in open loop). 


At the frequencies where |Syp (@)| < / (0 dB), the disturbance is attenuated. 
At the frequencies where |Syp (@)| > / (0 dB), the disturbance is amplified. 


Property 2 
For asymptotically stable closed loop system, and stable open loop, the integral of 
the logarithm of the modulus of the output sensitivity function from 0 to 0.5 f, 


satisfies! 


0.5 f, 
ll log 
0 


In other terms, the sum of the areas between the modulus of the sensitivity function 
and the 0 dB axis, taken with their sign, is null. As a consequence, the attenuation 
of disturbances in a certain frequency region implies necessarily the amplification 
of disturbances in other frequency regions. Figure 3.26 illustrates this 
phenomenon. 


Se Jaf =0 


10 For a proof of this property see Sung and Hara (1988). In the case of unstable open loop systems but 
stable in closed loop, the value of this integral is positive. 
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The output sensitivity functions shown in Figure 3.26 correspond to the 
example mentioned earlier for various values of @p (0.4; 0.6; 1 rad/s) but ¢ = 


constant (0.9). 
It follows that increasing the value of attenuation in a frequency region, or 


widening the attenuation band, will lead to a higher amplification of disturbances 
outside the attenuation band. Figure 3.26 clearly emphasizes this phenomenon. 


Property 3 
The inverse of the maximum of the modulus of the output sensitivity function 
corresponds to the modulus margin A M: 


AM = (Syp(eF)|max) 2 (3.6.6) 


The modulus margin is defined as the minimal distance between the Nyquist plot 
of the open loop transfer function and the critical point [-/, 70]. The typical values 
for the modulus margin (see Section 2.6) are 


AM > 0.5 (-6 dB) [min: 0.4 (-8 dB)] 


Recall that a modulus margin AM = 0.5 implies a gain margin AG = 2 and a 
phase margin Ag> 29°. To assure a safe modulus margin, it is necessary that: 


|SypleJ@)| max < 6 dB (or exceptionally 8 dB) 
YP 
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Figure 3.26. Modulus of the output sensitivity function for different attenuation bands of the 


disturbance 
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From property 2, it is seen that the increase of the attenuation in a certain 
frequency region, or the increase of the attenuation band, will in general lead to the 
increase of MG )| nay and therefore a reduction of the modulus margin (and of 


the system robustness). 


Property 4 
Cancellation of the disturbance effect on the output (\Syp»|= 0) is obtained at the 
frequencies where 


Ae Se" = AeH ke se a0 | @o=27x fI f, 867 


This results immediately from Equation 3.6.1. Equation 3.6.7 with q= z= e/® 
defines the zeros of the output sensitivity function in the frequency domain. 
The fixed pre-specified part of S(q-/), denoted H (7), allows one to introduce 


the zeros at the desired frequencies. 
For example 


Hq) =1-¢q! 


introduces a zero at the zero frequency and allows a perfect rejection of constant 
disturbances 


Hq) =1+ ag! q? 


with æ = -2cos (@T;) = -2cos (27 ffs) introduces a pair of undamped complex 
zeros at the frequency f (more precisely the normalized frequency ffs), while 


Hs (q) =1 + a,q!+ ang? 


allows one to introduce complex zeros with non-null damping. The damping is 
selected as a function of the desired attenuation at a given frequency. 

In Figure 3.27 the output sensitivity functions are shown for the cases H,(q/) = 
1 - g/and Hq’) = (1 - g’ + q’). The closed loop poles are defined for both 
cases by (wp=0.6 rad/s and ¢=0.9). The second choice for Hs introduces, in 
addition to the integrator, a pair of undamped (¢=0) complex zeros at 0.25 f;. One 
observes a very strong attenuation both at null frequency and at 0.25 f (<-100 dB). 
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Property 5 
The modulus of the output sensitivity functions is equal to 1, that is 


|Syp(e7®)| = 1 (0 dB) 
at the frequencies where 
B(e!®)R(e!”) = B (eH ple R (el?) =0 ; w= 22 f/f, (3.6.8) 


This results immediately from Equation 3.6.1 since under the condition of 
Equation 3.6.8 one gets Spo) = 1. 


The specified fixed part of R(q~/), denoted H RAT ), allows one to obtain a null 


gain for R(q-^) at certain frequencies, assuring at these frequencies |S, (e7| =] 
(open loop type operation). 
For example, 


Arq!) =1+¢q! 
introduces a zero at 0.5 f, implying |S, (e7)| =f; 


Syp Magnitude Frequency Responses 


Magnitude (dB) 


— HE (1+ gô -q') 


i 

I 

I 

F eer -1 
i Hg=1-q 
1 

1 

1 


0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 
Frequency (f/f ) 


Figure 3.27. Output sensitivity function for the case Hs(q!) = (l - q’) and 
Hg(q!)= (1 -q°!) (1+?) 
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Hga’) = 1+ py! +q? 


with 2 = -2cos (œ T) = -2cos 27 f/f, introduces a pair of undamped complex zeros 


at the normalized frequency f/f, leading to [Syp eiT] =]. 


Hga!) =1+ Biq! + Bog? 


introduces a pair of complex zeros with a non null damping, allowing to influence 
the attenuation of the disturbance at a certain frequency. 
Figure 3.28 illustrates the effect of the Hp(q/) = 1 + q?, which introduces a 


pair of complex zeros with null damping at f = 0.25 fẹ. One can see that, in the 
presence of H RAT ), one has [Splet ®)| = ] (0 dB) at this frequency, while, without 
introducing Hg(q”) one has at f = 0.25 f, a gain ISyple7®)]| =3dB. 

Note also that R(z/) defines some of the zeros of the input sensitivity function 
Sa) (given in Equation 3.6.2). Therefore at the frequencies where R(z“/) = 0, 
this sensitivity function will be null. 


Property 6 
The introduction of asymptotically stable auxiliary poles P;(z') leads in 
general to the reduction of |S,,(z!)| in the attenuation band of 1/P p21). 
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Figure 3.28. Output sensitivity function for the case Hea) = 1 and Hq!) =1+ q2 
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From the expressions of the sensitivity function in Equation 3.6.1 and of the 
closed loop poles, one can see that J//Pp(z!) P,(z!)) will introduce a stronger 


attenuation in the frequency domain than //P,(z~!), provided that the auxiliary 
poles defined by P;{z/) are asymptotically stable aperiodic poles. However, since 


Sz‘) will depend upon these poles through Equation 3.6.4, this property cannot 
be guaranteed for all possible values of P,{z~/). 


The auxiliary poles are in general selected as real poles located at high 
frequencies, and they take the form 


Pp (q) = 0+ pq ty" -0.5 < p' < -0.05 
where 
np, < np- np, > "pS (deg P)max > Np, = deg Pp 


The effect of auxiliary poles is illustrated in Figure 3.29. 


Remark.-in many applications, the introduction of high frequency auxiliary poles is 
enough in order to assure the imposed robustness margins. 


Property 7 
Simultaneous introduction of a fixed part Hs, and of a pair of auxiliary poles 


Pp in the form 


Hs, (z"') E 1+ 8z + Boz” 


(3.6.9) 
Pp, (z!) 1+ az + az”? 
resulting from the discretization of the continuous-time filter 
2 2 
+2 OS +o 
F()=5 $ mmo £ (3.6.10) 
Ka a 26 den@oS F Mo 
using the bilinear transformation" 
-z 
gas (3.6.11) 
T,1+z" 


11 The bilinear transformation assures a better approximation of a continuous-time model by a discrete- 
time model in the frequency domain than the replacement of differentiation by a difference, i.e. s = (1- 


vty Ts (see Equations 2.3.6 and 2.5.2). 
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introduces an attenuation (a “hole”) at the normalized discretized frequency 
Die = zarota SU) (3.6.12) 
2 
as a function of the ratio Cyum/S den <1. The attenuation at © J;e is given by 


M, = 20 of Sa > cae < C den ) (3 6. 13) 


den 


The effect upon the frequency characteristics of Sy at frequencies f << fiise and 
Sf >> faisc is negligible. 

Figure 3.30 illustrates the effect of the simultaneous introduction of a fixed part 
Hs and a pair of poles in P, corresponding to the discretization of a resonant filter 
of the form of Equation 3.6.10. One observes its weak effect on the frequency 
characteristics of Syp , far from the resonance frequency of the filter. 

This pole-zero filter is essential for an accurate shaping of the modulus of the 
sensitivity functions in the various frequency regions in order to satisfy the 
constraints. It allows one to reduce the interaction between the tuning in different 
regions. 
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Figure 3.29. Effects of auxiliary poles on the output sensitivity function 
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Figure 3.30. Effects of a resonant filter H /P, on the output sensitivity functions. 


Design of the Resonant Pole-Zero Filter Hs / Pp, 
The computation of the coefficients of Hs and Pp, is done in the following way: 


Specifications: 


e Central normalized frequency faise (@gise = 27 Sutise ) 


° Desired attenuation at frequency fiisc: Mt dB 
° Minimum accepted damping for auxiliary poles 


Pr, : (Caen) min (2 0.3) 


Step I: Design of the continuous-time filter 


2 O M,/20 
WM = T tan} ~ O< Ojise SA C niini =10 ! C den 
S 


Step II: Design of the discrete-time filter using the bilinear transformation of 
Equation 3.6.11. 
Using Equation 3.6.11 one gets: 


by +baz™ +b” _ i 1+ Bz” + bz” 


=i 
Fœ )= z] =) a 2 
Ay tA,Z +2 l+a,zZ +z 


(3.6.14) 
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which will be effectively implemented as!” 


a H(z") 2 1+ 8z” + baz” 
P(z") l+a,z" +z” 


F(z") 


where the coefficients are given by 


4 C num 8 
bag = pet A + 3 ba = 20) — Fr 
= 4 C mumo 2 
b. = T oak aia. (3.6.15) 
4 Sden® 8 
äi = a tA ; a, =20, 7 
4 C aen® 2 
TE a a 
y= b.o 
a9 
b b 
B= ; p= (3.6.16) 
b.o b.o 
ay ay Sie = a2 
a2 a9 


The resulting filters Hş and Pp can be characterized by the undamped resonance 
frequency @, and the damping ¢ . Therefore, first we will compute the roots of 


numerator and denominator of F'(z~') . One gets 


BENA- _ 4 aio, 


2n1,2 7 
(3.6.17) 
= + j4 4a, -af L A ejti 
Zd1,2 7 de 


From Table 2.4 and expressions given in Section 2.3.8, one can establish the 
relation between the filter and the undamped resonance frequency and damping of 
an equivalent continuous-time filter (discretized with a ZOH). The roots of the 
second-order monic polynomial in z” have the expression 


= oS aise sels gt} OaseTsAI-Ciise (3.6.18) 


21,2 


12 The factor y has no effect on the final result (coefficients of R and S). It is possible, however, to 


implement the filter without normalizing the numerator coefficients. 
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Bandstop Filters Magnitude Frequency Responses 
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Figure 3.31. Frequency characteristics of the resonant filter H ç / Pp used in the example 


presented in Figure 3.30 


One gets therefore for the numerator and denominator of F (z`) 


, In A, 
®onum = j S numd = T 
Mnumt s (3 6. 19) 
In A, 
Odden = , G dend Ba T 
Oden! s 


where the indexes “num” and “den” correspond to Hs and Pr, respectively. These 
filters can be computed using the functions filter22.sci (Scilab) filter22.m 
(MATLAB") and also with ppmaster (MATLAB*")®. 

Remark: for frequencies below 0.17 f; the design can be done with a very good 
precision directly in discrete-time. In this case, @) =®o,den =®0,num and the 


damping of the discrete time filters H, and P; is computed as a function of the 


attenuation directly using Equation 3.6.13. 

Figure 3.31 gives the frequency characteristics of a filter Hs / Pr obtained by 
the discretization of a continuous-time filter and used in Figure 3.30 (continuous 
line) as well as the characteristics of the discrete-time filter directly designed in 
discrete time (dashed line). The continuous-time filter is characterized by a natural 


13 To be download from the book website (http-//landau-bookic.lag.ensieg.inpg. fr). 
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frequency œ, =1 rad/s (f, =0.159 f), and = dampings Ġpm =0.25 and 
Caen = 0.4. The same specifications have been used for a direct design in discrete- 


time. One observes a small difference at high frequencies but this is not very 
significant. The differences will become obviously more important as @ọ 


increases. 
Remark: while Hg is effectively implemented in the controller, Pp; is only used 


indirectly. Pp will be introduced in Equation 3.6.5 and its effect will be reflected 
in the coefficients of R and S obtained as solutions of Equation 3.6.5. 


3.6.2 Properties of the Input Sensitivity Function 
Property 1 


Cancellation of the disturbance effect on the input (i.e. Sup= 0) is obtained at 
frequencies where 


A(e"”)H p (e!°)R(e!”) =0 : O=2n IÍ, (3.6.20) 


At these frequencies S,,= J (see Property 5 of the output sensitivity function) and 
the system operates in open loop. 
Figure 3.32 illustrates the effect of Ci on | Sup | for 


Hp(q')=1+fq  0< RK! (3.6.21) 
for $=1, one has | S, | = 0 at 0.5 f; . Using 0< f <1 one could reduce more or less 
the modulus of S,, around 0.5 f, Note that this structure for Arq") is 
systematically used for reducing the modulus of the input sensitivity function at 


high frequencies. 
One can also use 


Hp(q')=(+fq')" 0< BS! 
(usually n=/ or 2). 


Property 2 
At frequencies where 


AeH, (e®)S' (e7?) =0 : oO=2n Sl f. (3.6.22) 
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Figure 3.32. Effect of the filter Hp (q7)=1+ pa` 0< <1 on the modulus of the 
input sensitivity function: a) 8 =0;b) 2 =0.5; c) B =1 


which correspond to frequencies where a perfect rejection of disturbances is 
achieved (S\,= 0), one has 


Ale) 
B(e!®) 


(3.6.23) 


Sup (e7?) 


Equation 3.6.23 corresponds to the inverse of the gain of the system to be 
controlled. The implication of Equation 3.6.23 is that cancellation (or in general 
an important attenuation) of disturbances on the output should be done only in 
frequency regions where the system gain is large enough. If the gain of the 
controlled system is to low, |S„p| will be large at these frequencies. Therefore, the 
robustness vs additive term uncertainties will be reduced and the stress on the 
actuator will become important. Equation 3.6.23 also implies that serious problems 
will occur if B(z') has complex zeros close to the unit circle (stable or unstable 
zeros) at frequencies where an important attenuation of disturbances is required. It 
is mandatory to avoid attenuation of disturbances at these frequencies 
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Property 3 
Simultaneous introduction of a fixed part Ap and of a pair of auxiliary poles 


Pp having the form 


Hp, (z') 7 1+ 8z! + bz” 
2 


Pr, (z1) 1+ az +a 
resulting from the discretization of the continuous time filter 


2 2 
F(s) _ S + 26 num@08 + 0 


s? + 26 tengs + o 


using the bilinear transformation 


introduces an attenuation (a “ hole”) at the normalized discretized frequency 


Djise = 2 arotan 2 ) 
2 


as a function of the ratio Č pum! Ġ den <1- 


The attenuation at @ gişe is given by 


M, =20 oe Se > Cae < Caen) 


den 


The effect on the frequency characteristics of Syp at frequencies f << faise and 


f >> faisc is negligible. 
The design of these filters is done with the method described in Section 3.6.1. 
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Figure 3.33. Desired template for the output sensitivity function (case of disturbances 
rejection at low frequencies) 


3.6.3 Definition of the “Templates” for the Sensitivity Functions 


The performance and robustness specifications lead to the definition of desired 
“templates” for the frequency characteristics of the sensitivity functions. Most 
often we are interested in attenuating the disturbances at low frequencies, while 
assuring certain values for the modulus and delay margins, in order to achieve both 
good robustness and low amplification of disturbances outside the attenuation 
band. Figure 3.33 shows a typical template for the modulus of the output 
sensitivity function. 

This template is defined by accepted maximum values for the modulus of the 
output sensitivity function (“upper template”). One can also consider introducing a 
“lower template” since on one hand a too large attenuation in a certain frequency 
region will induce a too important increase of the modulus of the sensitivity 
function at other frequency regions (and IS yplmax will increase) and, on the other 


hand, the delay margin requires a “lower template” to be considered. 

However, more complex templates will result if, for example, the attenuation 
should occur in several frequency regions and if, in addition, it is required that the 
system operate in open loop at a specified frequency (neither amplification, nor 
attenuation of the disturbance). Such a type of template is shown in Figure 3.34. 
The constraints on robustness and on the actuator also lead to the definition of an 
upper template for the modulus of the input sensitivity function Sup 


Recall first that the inverse of the modulus of Sup gives at each frequency the 


tolerated additive uncertainty for preserving the stability of the loop (see Chapter 2, 
Section 2.6). Therefore, in the frequency regions where there are uncertainties 
upon the plant model used for the design, one should impose a very low acceptable 
value for the modulus of the input sensitivity function Sup: 

We recall that opening the loop OP 0) may be required at specified 
frequencies either because the system should not react to a particular disturbance 
(see Section 3.6.6), or because one would not like to excite the plant at certain 
frequencies (for example the plant is characterized by high frequency vibration 
modes). 
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Figure 3.34. Desired templates for the modulus of the output sensitivity function (case of 
disturbances rejection at certain frequencies and open loop operation required at a specified 
frequency) 


Moreover, for robustness reasons and insensitivity to noise at high frequencies, one 
systematically reduces the modulus of Sup close to 0.5 f, (often by opening the loop 
at 0.5 f). 

The limitation of the actuator stress in certain frequency regions (often at high 
frequencies) induces a limitation of acceptable values of the modulus of Sup in 
these frequency regions. 


An example of a template for |S,,,| is given in Figure 3.35. 


up 


Limitation of the stress on the 


N 


actuator 


Uncertainty region upon thè model quality 


Loop opening at 
the frequency f (< -100 dB) 


Figure 3.35. Example of a desired template for the modulus of the input sensitivity function 
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3.6.4 Shaping of the Sensitivity Functions 


In order to achieve the shaping of the modulus of the sensitivity functions such that 
the constraints defined by the template are satisfied, one has the following 
possibilities: 


. Selection of the desired dominant and auxiliary poles of the closed loop 
2. Selection of the fixed parts of the controller (H Rg! ) and H; gq )) 


3. Simultaneous selection of the auxiliary poles and of the fixed parts of the 
controller 
Despite the coupling between the shaping of the output sensitivity function and 
the input sensitivity function, it is possible, in practice, to deal with these two 
problems almost independently. 
In particular, it is useful to remember that at frequencies where Spl is close to 


1 (0dB), [Supl is close to 0 (<-60dB). 


Automatic methods using convex optimization techniques (Langer and Landau 
1999; Langer and Constantinescu 1999; Adaptech 1998a) are available in order to 
solve the shaping problem'*. However, in most of practical situations, it is 
relatively easy to calibrate the sensitivity functions using the tools previously 
indicated, and taking into account the properties of the sensitivity functions. 

The iterative procedure that will be presented next is very efficient and helps to 
understand the operation of the controller. However, the use of a CACSD tool like 
ppmaster (MATLAB") (Prochazka and Landau 2001) will considerably 
accelerate the procedure. 


Shaping the Output Sensitivity Function. 
The shaping objective can be summarized as follows: given a desired attenuation 
band, select the closed loop poles and the fixed parts Hp(q~/) and Hs(q~) in order 


to “flatten” |S),(e/®)| outside the attenuation band, and to reduce Syp (eio) nax 


while satisfying Property 2. 

Often the selection of auxiliary poles and of Hg(q ^) and Haq’) is sufficient for 
matching the performance and robustness specifications. However, for a fine 
tuning, it may be also necessary to select simultaneously the fixed part H.(g~/) and 
the auxiliary poles. (see Property 7: second-order pole-zero filter). 

The iterative procedure for the shaping of the output sensitivity function can be 
summarized as follows'*: 


'4 To apply convex optimization techniques, the Youla-Kucera parametrization of the controller is used. 
See Appendix E. 

15 Available on the book website (http://landau-bookic.lag.ensieg.inpg fr). 

'6 The principles of the methodology for shaping the output sensitivity function can be extended to the 
shaping of other sensitivity functions. 
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Step I 


e Selection of P(g!) and fixed parts H,(q/) and Hq‘) from the 
performance specifications. (Example: zero steady-state error will require 
the introduction of Hg!) = 1 - q!, opening the loop at a certain 


frequency will require Hp(q/) = 1 + aq! + gq’) 
e Controller computation 
e Analysis of the resulting output sensitivity function. 


If the upper template corresponding to the desired modulus margin AM = 0.5 


and the delay margin Ar= T, are violated, one can distinguish three different 


solutions: 


1. The maximum of the modulus of the sensitivity function is at high 
frequencies (the resulting controller is often unstable as a consequence 
of Property 2, since the area between the modulus of the sensitivity 
function and the 0 dB axis is positive). 

2. A local maximum of the modulus of the sensitivity function is located 
in a frequency region close to the attenuation band. 

3. The modulus of the sensitivity function presents a maximum both at 
low and high frequencies. 


Case 1 and 3 


Step II 
One introduces auxiliary poles at high frequencies: 


np . 
Pq) =(+pq)” >° -0.052 p; -0.5 


with increasing values of |p || starting from 0.05. 


The number of auxiliary poles that can be introduced without increasing the 
size of the controller is given by 


np, < np- Mp; Np= (deg P) max? Np = deg Pp 


The value of |p;| is increased in order to avoid a violation of the template of the 


sensitivity function at high frequencies (i.e. over 0.25 fs or 0.30 fs). 

Usually, the maximum of the modulus of the sensitivity function will move 
towards low frequencies. If this maximum is above the template we are in case 2 
which will be discussed next. 


Case 2 


Step II — Use of second-order pole-zero resonant filters H 5 /P,. 
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One identifies first the frequency region where Spl is above the “upper template”. 
One finds the value of the frequency at which the maximum of Spl occurs and the 


attenuation which should be introduced in order to be below the upper template. 
Then one computes the corresponding filter H;/P, on the basis of these 


specifications. The selection of the damping of the denominator depends to some 
extent upon the width of the frequency region where DA is above the template. 


Some Hints 


e Ifthe modulus of the sensitivity function presents a too strong minimum at 
high frequencies, or in the central frequency region, this can be raised by a 
few dB by adding a pair of complex auxiliary poles placed at the frequency 
corresponding to the minimum 

e Ifthe attenuation band increases, then one should impose slower dominant 
poles 

e Ifthe attenuation band is reduced as a consequence of the introduction of 
the auxiliary poles, then one can either raise the natural frequency of the 
dominant poles, or introduce a further zero-pole filter around the frequency 
corresponding to the desired attenuation band. 


In order to match the constraints in the high frequency region corresponding to 
the imposed delay margin, one can either use auxiliary poles or impose the opening 


of the loop at 0.5 fs ( Hg(q 7) = 1 + q’). In practice, a simultaneous application of 
both solutions can be considered. 


Step III 

One iterates around the values of the dominant and auxiliary poles selected in step 
I and II in order to get the best result in terms of robustness and performance 
constraints matching. 


Shaping the Input Sensitivity Function 

The shaping of the input sensitivity function is usually performed after the shaping 
of the output sensitivity function. If the value of the modulus of the input 
sensitivity function is not enough low at high frequencies (frequencies close to 0.5 


fs), one introduces a fixed part Hp(q~/) of the form 
Haq ')=(+ fy)" 0.5<8<1 n=12 


This will have, in general, a weak interaction with the shaping of the output 
sensitivity function. 
In the frequency regions where there are uncertainties upon the plant model, 


|S „p| Should be low (upper bound defined by the template). If the resulting 


ip 
sensitivity function does not fulfill the specifications, one has to introduce a pole- 


zero resonant filter H p, / Pp, . In order to match the template imposed on |Sup| the 
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resonance frequency of the filter is chosen close to that corresponding to the local 
maximum of |S,,p|, and an appropriate damping is selected in order to provide the 
required attenuation. 

Once the shaping of |Sup| is achieved, one should go back to check if |S,,| still 
match the template (an appropriate CACSD like ppmaster allows to shape 
simultaneously both sensitivity functions). 


3.6.5 Shaping of the Sensitivity Functions: Example 1 


The considered plant model is characterized by 
Aq!) =1-0.7q!' ; Bg')=03q!' ; d=2 ; T,=I1s 


An integrator is imposed in the controller. One considers the roots of the 
polynomial obtained from the discretization of a second-order continuous time 
system with @) = I rad/s, and ¢ = 0.9 as the imposed dominant poles for the 


closed loop. The controller is designed by means of pole placement. The output 
sensitivity function corresponding to this design is shown in Figure 3.37 (curve A). 
It crosses the standard robustness template defined by AM = - 6dB and AT = T. 


Both obtained margins (modulus and delay) are lower than specifications (see 
Table 3.5). The upper frequency of the attenuation band is at 0.058 Hz. 
The objective is to obtain the same attenuation band but with 


AM > - 6dB (|S 6dB) and At > T, 


yplmax < 


First we will add auxiliary real poles. From Equations 3.3.22 and 3.3.23 it results 
that one can assign a number of closed loop poles equal to: 


np = deg P(q!) <ng+nys +ng+nypt d-1 


without increasing the size of the controller. Since in this example n4 =/, ng =/, 
nys =1, d = 2, one can assign four poles. Two poles have been already assigned as 
dominant poles and therefore we will add two auxiliary poles of the form 


P qD =(1-04q 


The resulting sensitivity function is shown in Figure 3.36 (curve B). The 
constraints on the modulus margin and the delay margin are satisfied but the 
attenuation band has been reduced (0.045 Hz instead of 0.058 Hz). 
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Syp Magnitude Frequency Responses 


Magnitude (dB) 


=.. Template for Modulus margin 
--- Template for Delay margin = T, 


-25 È L I Į Į 
0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 


Frequency (fff) 


Figure 3.36. Output sensitivity functions corresponding to different RST controllers (see 
details in Table 3.5) 


In order to increase the attenuation in this frequency region without influencing 
high frequency regions, one chooses a pole-zero filter H,/P’,, centered at @)=0.4 
rad/s (f=0.064 Hz) with Hç resulting from the discretization of a second-order 
continuous-time system with @) = 0.4 rad/s and ¢ = 0.3, and P’; resulting from 
the discretization of a second-order continuous-time system with @, = 0.4 rad/s 
and ¢ = 0.5 (we are below 0.17 f; and the direct design of the discrete filter is 
possible). Since Grum = 0.3 and Caen = 0.5, an attenuation will result at 0.064 Hz. 
The corresponding sensitivity function is shown in Figure 3.36 (curve C). One 


observes that the attenuation band matches the specifications but the maximum 
value of IS | is slightly higher than 6 dB. In order to match this constraint the value 


of the real auxiliary pole is increased from 0.4 to 0.44. The final sensitivity 
function is shown in Figure 3.36 (curve D). 


3.6.6 Shaping of the Sensitivity Functions: Example 2!” 


The considered plant model is characterized by 


Aq) =1-q! ; Bg)=05q! ; 


a 
ll 
N 
m 
Il 
~ 
t 


17 This example and the corresponding specifications are related to the continuous casting of steel. 


162 Digital Control Systems 


Table 3.9. Shaping of sensitivity functions- example 1 


Modulus | Delay | Attenuation 
HAT D Closed loop poles margin | margin band 
Dominant Auxiliary (dB) (Ts) (Hz) 
A Le g --- 
c=0.9 -7.71 0.4 0.058 
1| Cont n2 
B | 1-q¢ (1 - 0.4q"") 
C=0.9 -5.81 3.07 0.045 
pay (1-0.4q"1)? 
% =] 
C | wp=04 a=0.4 -6.33 5.01 0.063 
6=0.9 
¢ =0.3 6=0.5 
(1-0.44q7!)? 
% =] 
D idem @=0.4 -5.99 5.34 0.060 
C=0.9 
6=0.5 


The plant has an integrator behavior with delay. The plant is subject to two 
types of disturbances: 


e Low frequency disturbances that should be attenuated 
e A sinusoidal disturbance at 0.25 Hz that should not be compensated by the 
action of the controller 


The block diagram related to the plant model is shown in Figure 3.37. 
The robustness and performance specifications are as follows: 


1. No attenuation of the sinusoidal disturbance at f = 0.25 Hz (|S 0 dB at 


pl = 
0.25 Hz) 
2. Attenuation band at low frequencies (frequency region corresponding to 
Syl < 0dB): 0 to 0.03 Hz 
3. Disturbances amplification at 0.07 Hz less than 3 dB (Syl < 3 dB at 0.07 
Hz) 
4. Modulus margin > -6 dB (|S. 


yplmax 


< 6 dB) 
5. Delay margin > Is (T) 


6. No integrator in the controller 
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Low frequencies 


disturbances Sinusoidal 
disturbance 


u(t) qB | + y(t) 


A + 
Figure 3.37. Block diagram for plant model and disturbances 
The presence of an integrator has not been imposed because the plant model 


has already an integrator behavior. 
One starts by designing the fixed parts of the controller, Hp(q™!) and H q7 ). In 


order to obtain IS, = 0dB at 0.25 Hz = 0.25 f., one should introduce Hp(q™‘) with 
a pair of undamped complex zeros at this frequency. This is obtained by 


Hyg!) = 1+ By! + q? 
with 
P = -2cos (@T,) = -2 cos (27 f/f.) 


From the condition 


H,(e 2”) = 


a=a,/4 


it results that 
B= -2cos (27. 0.25) = 0 


and then 
Hell) = 1+ q? 


Since there is no integrator imposed in the controller, as a first choice one chooses 
Hq”) = 1. One selects for the dominant poles a polynomial P(g“) resulting from 


the discretization of a second-order continuous-time system with wg = 0.628 rad/s 
(fo = 0.1 Hz) and C= 0.9. 
The corresponding sensitivity function is shown in Figure 3.38 (curve A). 
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Syp Magnitude Frequency Responses 
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Figure 3.38. Output sensitivity functions corresponding to different RST controllers (see 
details in Table 3.6) 


One observes that the specifications at 0.07 Hz are not satisfied. On the other 
hand one can remark that IS, is equal to 1 (OdB) for f = 0.25 fs = 0.25 Hz, as 
required. 

In order to reduce the modulus of the output sensitivity function at f= 0.07 Hz, 
one considers the introduction of a narrow-band pole-zero discrete filter Hs /Pr 


centered at œ) = 0.44 rad/s (fo =0.07 Hz). Since the frequency fo is below 0.17 fy, 
one can directly design the discrete-time filter. One chooses for Hs a damping ¢ = 
0.3 and for Pp a damping ¢=0.4, corresponding to a filter attenuation of about 2.4 
dB around @p. Using this filter (that is Hs and Pr) one obtains the sensitivity 
function shown in Figure 3.38 (curve B). The attenuation introduced by this filter 
at 0.07 Hz is sufficient (|S\,|0.074z =2.6 dB) but the width of the attenuation band 
is smaller than the specified one. In order to correct that, it is sufficient to increase 
the natural frequency of the dominant poles. With wg = 0.9 rad/s (instead of 0.628) 
one obtains the sensitivity function shown in Figure 3.38 (curve C). All the 
specifications are fulfilled. The results are summarized in Table 3.10. 

Note that the choice of Hs /Pr is not critical. The specifications can also be 
satisfied with a discrete-time filter Hs /Pp centered at wp = 0.5 rad/s with 
Cnum=0.35 and Cgen=0.45. 

The same design steps will be followed for the case when an integrator is 
introduced in the controller. 
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Table 3.10. Shaping of the sensitivity functions - Example 2 


Attenua- | Modulus | Delay [Syp] 


Closed loop poles ; ‘ : 0.07 
Hp Hs tion margin | margin ; 
band Hz 
Dominants Auxiliaries (Hz) (dB) (Ts) (dB) 
= 0.628 
A l+q? ae c=09 0.03 -4.12 6.52 4.11 


B I+q? 0.026 -3.06 7.61 2.6 
C= 0.3 c= 0.9 C=04 


2 i @g = 0.9 
c |g idem Fis 0.03 | -3.94 | 6.62 | 2.6 


3.7 Concluding Remarks 


In this chapter several digital control designs in a deterministic environment have 
been presented. All the digital controllers have a three-branched structure (RST), 
corresponding to a control law of the form 


S(q!) u(t) + RAI) yO = Tq!) y"(t+dt+ 1) 


where u is the control input, y is the output of the plant, y“ is the desired tracking 
trajectory and d is the time delay. 
The design of the controller involves essentially two stages: 


1. Computation of the polynomials S(q-/) and R(q~/) in order to match the 

desired regulation performances 

2. Computation of the polynomial 7(q~/) in order to approach (or to match) 

the desired tracking performances 
The digital controllers are perfectly suited for the control of plants characterized by 
high order models with time delay and/or resonant modes. The controller 
complexity (i.e. the degrees of the polynomials R(q~/), S(q/), T(q-/)) depends 
upon the complexity of the polynomials of the plant model transfer function. The 
discrete-time plant model used for design can be either obtained directly by an 
identification technique, or by computation from the continuous-time model. 

The pole placement control strategy is applied to plants having discrete-time 
models both with stable and unstable zeros. It makes possible to match the desired 
regulation performance and the desired tracking performance filtered by the plant 
Zeros. 

The tracking and regulation with independent objectives allows to match 
perfectly the desired tracking and regulation performances, but, in order to be 
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applied, the pulse transfer function of the discrete-time plant model must have 
stable zeros. 

The internal model control strategy is a particular case of the pole placement in 
which the plant model poles are chosen as closed loop system poles. This strategy 
can only be applied to enough damped stable systems. The closed loop dynamics is 
not faster than the open loop dynamics. 

The digital PID controllers are directly designed by pole placement on the basis 
of discrete-time models of the plants to be controlled. This technique can be 
applied to plants characterized by discrete-time models of lower order (Max < 2 ). 


Two structures of digital PID controllers have been examined. The difference is 
only in the choice of the polynomial 7(q~/). It is advisable to use the choice 7(q~/) 
= R(1) (corresponding to the digital PID 2), which offers better tracking 
performances. The digital controllers designed by the methods presented in this 
chapter implement a predictive control in the time domain. They implicitly contain 
a predictor of the plant to be controlled. 

Independently of the design method used, it is required to verify the robustness 
margins of the closed loop (mainly the modulus margin and the delay margin). 
Taking into account simultaneously performance and robustness margins may 
require the shaping of the sensitivity functions (output and input sensitivity 
functions), by imposing pre-specified fixed parts in the controller and choosing 
appropriate closed loop system poles. 

An iterative methodology for the shaping of the sensitivity functions has been 
presented in Section 3.6.4. Moreover, it is possible to obtain in an automatic way 
the controller, fulfilling the various constraints on the sensitivity functions, by 
means of a convex optimization procedure (see Langer and Landau 1999; 
Adaptech 1998b). 


3.8 Notes and References 


For different types of digital PID controllers and their computation by means of the 
pole placement see: 


Astrém K.J., Wittenmark B. (1997) Computer Controlled Systems Theory and 
Design, 3rd edition, Prentice Hall, N.J., U.S.A. 

Astrém K.J., Hagglund I. (1995) PID Controllers Theory, Design and Tuning, 2nd 
edition ISA, Research Triangle Park, N.C., U.S.A. 


The pole placement and the solution of the Bezout identity is discussed in: 


Goodwin G.C., Sin K.S. (1984) Adaptive Filtering Prediction and Control, 
Prentice-Hall, Englewood Cliffs, N.J. 
Kailath T. (1980) Linear systems, Prentice Hall, Englewood Cliffs, N.J. 


For the solution of the Bezout equation by means of recursive least squares see: 


Lozano R., Landau I.D. (1982) Quasi-direct adaptive control for nonminimum 
phase systems, Transactions A.S.M.E., Journal of D.S.M.C., vol. 104, n°4, pp. 
311-316, December. 
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For the numerical solutions of the Bezout equation see: 


Press W.H., Vetterling W.T., Teukolsky S., Flanery B. (1992) Numerical recipes in 
C (The art of scientific computing),2nd edition, Cambridge University Press, 
Cambridge, Mass. 


For the links between the pole placement and the optimal control with quadratic 
criterion see (Astrém and Wittemark 1997). 


Tracking and regulation with independent objectives is discussed in: 


Landau I.D., Lozano R. (1981) Unification of Discrete-Time Explicit Model 
Reference Adaptive Control Designs, Automatica, vol. 12, pp. 593-611. 


The interpretation and the design of RST controllers in the time domain are 
discussed in appendix B. 


Robust control of systems with delay and links with the Smith predictor and the 
internal model control are discussed in: 
Landau I.D. (1995) Robust digital control of systems with time delay (the Smith 
predictor revisited), Int. J. of Control, vol. 62, pp. 325-347. 


For properties of the integral of the sensitivity functions in discrete-time see: 


Sung H.K., Hara S. (1988) Properties of sensitivity and complementary sensitivity 
functions in single-input, single-output digital systems, Int. J. of Cont., vol. 48, 
n°6, pp. 2429-2439. 


For examples about the iterative design methodology using pole placement with 
shaping of the sensitivity functions see: 


Landau I.D., Langer J., Rey D., Barnier J. (1996) Robust control of a 360° flexible 
arm using the combined pole placement / sensitivity function shaping method, 
IEEE Trans. on Control Systems Tech., vol. 4, no. 4, pp. 369-383. 

Landau I.D., Karimi A. (1998) Robust digital control using pole placement with 
sensitivity function shaping method, Int. J. of Robust and Nonlinear Control, 
vol. 8, pp. 191-210. 

Prochazka H., Landaul.D. (2003) Pole placement with sensitivity function shaping 
using 2nd order digital notch filters, Automatica, Vol. 39, 6, pp. 1103-1107. 


For an “automatic” solution based on convex optimization for designing robust 
digital controllers by means of the pole placement with shaping of the sensitivity 
functions see: 


Langer J., Landau I.D. (1999) Combined pole placement / sensitivity function 
shaping method using convex optimization criteria, Automatica, vol. 35, no. 6, 
pp. 1111-1120. 

Langer J., Constantinescu A. (1999) Pole placement design using convex 
optimization criteria for the flexible transmission benchmark, European 
Journal of Control, vol. 5, no. 2-4, pp. 193-207. 

Adaptech (1998) Optreg — Software for automated design of robust digital 
controllers using convex optimization (for MATLAB®), Adaptech, St. Martin 
d’Héres, France. 
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Design of Digital Controllers in the Presence of 
Random Disturbances 


A large number of systems are subject to disturbances of a random nature. In the 
first part of this chapter models suitable for the representation of these stochastic 
disturbances (the ARMAX models) will be presented and their properties analyzed. 
Three design methods will be presented: 1. minimum variance tracking and 
regulation (which minimizes the mean-square difference between the reference and 
the controlled variable); 2. the approximation of the minimum variance tracking 
and regulation by means of the pole placement (for the case of systems with 
unstable zeros); 3. generalized minimum variance tracking and regulation. 


4.1 Models for Random Disturbances 


4.1.1 Description of the Disturbances 


First consider the basic deterministic disturbances, namely the Dirac pulse, the step 
and the ramp, represented in Figure 4.1. 


Dirac step ramp 
pulse 


Figure 4.1. Main deterministic disturbances 
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Figure 4.2. Deterministic disturbance models 


Note that the step and the ramp may be described as resulting from the passing 
of the Dirac pulse through a filter, as indicated in Figure 4.2. The corresponding 
filters are known as “disturbance models”. Any deterministic disturbance may be 
obtained by passing a Dirac pulse through a “disturbance model” (filter) having an 
appropriate structure. Knowledge of the “disturbance model” is equivalent to 
knowledge of the disturbance. 

What follows is an attempt to extend this concept of the “disturbance model” to 
the description of random disturbances. 

By random or stochastic disturbances, is meant those disturbances, which 
cannot be described in a deterministic way, given as they are not reproducible. 

To provide an example of a random (stochastic) process, one can consider the 
evolution of the controlled output of a plant in regulation on a significant horizon 
(one day) and during several tests (several days). This is illustrated in Figure 4.3. 


8h 10h 16h 


Figure 4.3. Recording of a controlled variable in regulation 


By examining Figure 4.3, one observes that the evolution during one day may 
be described by a deterministic function f(t), but that this function will be different 
every day (Af) is known as the “realization” of the stochastic process). 

If the time for carrying out the measurement of the observed variable is fixed 
(e.g. at 10 a.m.), each day (at each test) a new value will be measured (this it what 
is known as a random variable). However, for all values measured every day at the 
same time, statistics can be defined characterized by the mean value and the 
variance of the measurements. The probabilities of the occurrence of different 
values may be defined as well. 

The stochastic process (partially) represented in Figure 4.3, is dependent on the 
time (during a day) and on the experiment (first, second...fourth day). 

More formally, a stochastic process may be described as a function ft, é) 
where f represents the time and belongs to the set T of real variables, and ¢ 
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represents the stochastic variable (the outcome of an experiment), which belongs to 
a probability space S'. For a given = & , the function fit, čo) is a regular time 


function called a realization. For fixed t = tg the function f(tg, 4) is a random 


variable. The argument € is often omitted. 

If the stochastic (random) process is ergodic, the statistics related to an 
experiment (in our example over one day) are significant, i.e. the result obtained is 
identical to that obtained from measurements taken on several experiments when 
the time is maintained constant (at the same time of the day). If, in addition, the 
stochastic process is gaussian, the knowledge of the mean value and of the 
variance allows the probability of occurrence of a given value to be specified 
(Gauss's bell — see Appendix A). 

In practice, the majority of random disturbances occurring in automatic control 
systems may be accurately described as a discrete-time white noise passed through 
a filter. This discrete-time white noise is a random signal having an energy 
uniformly distributed at all frequencies between 0 and 0.5 fọ. Note that the discrete- 


time white noise has a physical realization, since it is a finite energy signal (the 
frequency band is finite), whereas the continuous-time white noise does not 
correspond to a physical reality since the energy is constant over an infinite 
frequency range (infinite energy signal). 

The filters that will constitute the random disturbance models will modify the 
frequency spectrum of the energy distribution of the white noise in order to obtain 
a distribution corresponding to the frequency distribution of energy of the various 
random disturbances encountered. 

The white noise has, in the random case, the same role as the Dirac pulse in the 
deterministic case. It constitutes the fundamental generator signal. 

The gaussian discrete-time white noise will henceforward be considered as the 
generator signal. This is a sequence of independent equally distributed gaussian 
random variables of zero mean value and variance o”. This sequence will be noted 
fe(t)} and will be characterized by the parameters (0, o), in which the first term 
indicates the mean value and o is the standard deviation (square root of the 
variance). A part of such a sequence is represented in Figure 4.4. 


Figure 4.4. Discrete-time white noise sequence 


' A set S containing all possible results of an experiment and having subsets called events, to which a 
probability of occurrence is associated and named a probability space. 
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The mean value (or expectation) is given by 


MV = Ele(t)}= tim Ye) =0 (4.1.1) 


t=1 


and the variance will be given by 
N 
var = Ek Oj lim — Ye (@)=0" (4.1.2) 
7% IN =] 


(note that sequence fe(t)} is an ergodic process, see above). 
The autocorrelation or covariance function R(i) is defined by the following 
expression: 


N 


R(i) = Ele(s)e(t-d} j= lim LSet- (4.1.3) 


t=1 


or, in other words, by the product between the sequence fe(t)} and the same 
sequence shifted by i-steps. 
Note that 


R(O) = var = œ (4.1.4) 
The normalized covariance (or autocorrelation) is defined as 


RO 


RNO = 20) 


(RN(0) =1) (4.1.5) 


In the case of the gaussian white noise, which is an ergodic process, since this is a 
sequence of independent random variables and taking into consideration the 
ergodic nature of the process, it results that the knowledge of e(t) does not allow an 
approximation of e(t +1), e(t + 2)... to be predicted, the best prediction being 0. 


This independence property is revealed in the following autocorrelation 
property (independence test for gaussian data): 


RG) =RN@) =0 1 =1,2,3..., -1, -2, -3.... (4.1.6) 
If the evolution of the normalized covariance for the white noise is plotted, the 


curve shown in Figure 4.5 is obtained’. 


2 This whiteness test is used even when a finite length sequence is available. In this case, 
|RN (i)| + 0 ,i =1,2,3,... but they must be smaller than a specified value. The whiteness test for a 
sequence of length N is discussed in Chapter 6, Section 6.2. 
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Since E{e(t)} = const. and E {e(t) e(t-i)} is only a function of i, the gaussian 
discrete-time white noise sequence has the properties of a weakly stationary 
stochastic process (in fact it is a real stationary stochastic process since the 
properties of the sequence /e(t)} are the same as those of the sequence fe(t+7)/). 
The knowledge of the covariances R(i) for a weakly stationary stochastic process 
makes it possible to compute the energy distribution in the frequency domain, 
known as the spectral density function. 


RN 


2-10 1 2 3 4 


Figure 4.5. Normalized autocorrelations of the white noise 


This is given by (discrete Fourier transform of the covariance function) 


1 S Ap Jio 
Ho) =z D RO 


i=—%0 


Since in the case of the discrete-time white noise all the R(i) = 0 for i + 0, it results 
that the spectral density of the discrete-time white noise is constant and equal to 


_ RO) _ o° 
#.(@) = 2m 27 


The spectral density of the white noise is represented in Figure 4.6. A uniform 
energy distribution between 0 and 0.5 fọ is observed. 


RO) —— 


2n | 0.5 f, 
| 


f 


Figure 4.6. Spectral density of the discrete-time white noise 
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4.1.2 Models of Random Disturbances 


As it has already been mentioned in Section 4.1, different types of random 
disturbances, whose spectral density can be approximated by a rational function of 
the frequency, can be considered as resulting from the filtering of a white noise 
through a shaping filter. Several types of processes thus obtained will be examined. 


“Moving Average” Process (MA) 
Consider, for example, the process 


VØ = et) + ce(t-L) = (Ite 7”) et) (4.1.7) 


which corresponds to the filtering of a white noise through a filter (/+c, q`’), as 
shown in Figure 4.7a. 


Toes fs 


Figure 4.7a,b. Generation of a “Moving Average” random process: a first order; b general 
case 


The mean value of y(® is ° 


N 
VM. = Ely(t)}= FL V0= Lora pD- (4.1.8) 


t= 


The variance of the process y(f) is 


R -Fywl--yyo-Lye 
0) = Ep? Wl O=W Le (+ 

P 7 (4.1.9) 
AY el-de 2S eet- )=(0+c?)o’ 

t=1 


t=l 


since the third term is zero (see properties of the white noise, Equations 4.1.3 and 
4.1.6). 


3 In the following we omit lim but one should recall that all formulas are rigorously valid 
No 


only for a large value of N( > œ). 
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From Equation 4.1.7, one obtains by shifting 
y(t-1) = e(t-1) + c, e(t-2) (4.1.10) 
which enables R (Z) to be computed: 
Š 1 < 
Ry) =EyOne-D}=— DP yO =e Odo AID 
t= t=l 
all the other terms being zero (expectations of products of shifted white noise 
sequences). 


In the same way one verifies that 


R,(2) =0 ; R3) =0..... R(n) = 0 (4.1.12) 


The plot of the normalized autocorrelations for this first-order “moving average” 
process is represented in Figure 4.8. 


Cy (c,>0) 


-2 -1 0 +1 2 


Figure 4.8. The normalized autocorrelation functions for a first-order “moving average” 
process 


The general form of a “moving average” process is 


y(t) = elf) + X c;elt—i)=C(q )e(t) (4.1.13) 
i=l 
where 


Cg )=14+ Sieg? =1+4q Cg") (4.1.14) 


i=l 
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The corresponding filter representation is given in Figure 4.7b. 
The “moving average” processes are characterized by the property 


Ri) =0 inl ; i<-(nctl) (4.1.15) 


The spectral density is given by the formula 
l 2 i202 
p, (w) = C(e!”)C(e”) = = ce’) ae (4.1.16) 
2m 2m 


o*/27 being the spectral density of the white noise (noted pd 2). 


This allows one to obtain the general relation between the spectrum of the input 
signal (white noise) of the generator filter and the spectrum of the moving average 
process: 


(2) = Cz) Cz") 62) (4.1.17) 


the frequency distribution being obtained for z = e/®. 
From Equations 4.1.16 and 4.1.17 it can be deduced that the knowledge of 


C (q) (the generator filter) allows one to obtain, for example, the spectral energy 


distribution of the random process, since the white noise spectral density is 
constant at all frequencies. 


“Auto-regressive”’ (AR) Process 
Consider, for example, the process 


y(t) = -a y(t - 1) + eft) = |a,|<1 (4.1.18) 
l+aq 


which corresponds to a white noise passed through a stable filter 7 (/+a, q~”) as is 
shown in Figure 4.9a. The general form of an “auto-regressive” process is given by 


na 


vO =-J ayt-) + e(0) (4.1.19) 
i=l 
which is also written as 


ATD yÒ = eli) (4.1.20) 


in which 
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ny 


Aq')=14+ $ aq" =1+q 7A" q) (4.1.21) 
i=l 


is a polynomial with all its roots inside the unit circle (A(z!) = 0 => |z| < 1). 


Figure 4.9a,b. Generation of an “Auto-Regressive” process: a) 15t order ; b) general case 
The spectral density of the auto-regressive process is given by the expression 


1 1 
z) = ——_-—— 6, (z 1.22 
$= F5q he (4.1.22) 


in which ¢,(z) = o°/2zand the frequency distribution is given by 


$, (0) = 9, (2) (4.1.23) 


z=el® 


“ARMA” Process (Auto-Regressive Moving Average) 
This process is obtained by passing a white noise through a stable filter with poles 
and zeros as is illustrated in Figure 4.10. 


e(t) y(t) 


Figure 4.10. Generation of an ARMA random process 
This process is described, in the general case, by 
ny 


y(t) = -> a;y(t-i)+ S cele ~i)+e(t) (4.1.24) 
i=l 


i=l 
or also in the form 


Ag!) Ò = Cg!) et) (4.1.25) 
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where A(q“/) is a polynomial (having all its roots inside of the unit circle) given by 
Equation 4.1.21 and C(q~/) is given by Equation 4.1.14. 
The spectral density of the ARMA process is given by 


(eœ ce) 4.1.26 
i [eho ice 


4.1.3 The ARMAX Model (Plant + Disturbance) 


This is the model used to represent the effect of both control and disturbances on 
the plant output. ARMAX means ARMA process with exogenous (external) input, 
which in our case is u(t). The generation of the ARMAX process is illustrated in 
Figure 4.11. 


Figure 4.11. Generation of the ARMAX random process 


The disturbed output of the plant y(t) is written as 


TBA”) ya) 


(1) (4.1.27) 
Aq!) Aq) 


yt) = 


in which the first term represents the effect of the control and the second term the 
effect of the disturbance. By multiplying both sides of Equation 4.1.27 by A(q-/), 
one obtains 


Ag) x) = 4 Bi) + Cig!) ef) ; (B=! BG") (4.1.28) 


which, taking into account the expressions of A(q~/), B(q-/) and C(q~“), is also 
written as 


(t+1)=-) a,y(t+1-i) +) bult+1-d-i)+Y ce(t+1-i) 
y i i i 


i=l i=l i=l 


+e(t +1) = -A (qy) + B (qult -d)+ C(q')e(t+)) 


(4.1.29) 
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The question that may arise concerns the presence of the denominator Aq! ), both 
in the transfer function of the plant and in the transfer function of the generator 
filter of the disturbance (see Equations 4.1.27). Is this a loss of generality as 
compared to the case where the two denominators are different, as shown in Figure 
4.12? 

In this case, output y(t) is given by 


Cy (q) 
A,(q') 


-d =] 
B 
q “Bq ) 


(i) = 
AG?) 


(t)+ e(t) (4.1.30) 


Reducing to the same denominator, one obtains 


-d -d 
q BiA C24 q` B C 
t)= u(t) + e(t) = u(t) +—e(t 4.1.31 
y(t) AA, (¢) AA, (¢) 7 (t) q ( ) 
where 
A=A,A, ; B=B,A, ; C=C, A, (4.1.32) 


which, generally speaking, enables the model given by Equation 4.1.27 to be used. 


Figure 4.12. ARMAX model with different poles 


4.1.4 Optimal Prediction 


Taking into account the random nature of the disturbances, it is not possible for 
ARMAX models to compute exactly the future value of y(t) at instant t+ / knowing 
all the values of y and u up to and including the instant t. 

For this reason one considers the concept of optimal prediction of the future 
value of y at the instant t+/, computed from the knowledge of y and u up to and 
including the instant ¢, which will be denoted j(t+1/f) or simply p(t+1). 


We define a prediction error as 
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e(t+1) = y(t+1)—$0 4) (4.1.33) 


The objective will be to construct an optimal predictor as a function of the 
available information at instant t: 


p(t +1/t) = yt +) = fA), y(t -D,....u(),u(t - 1),...) (4.1.34) 


such that the variance of the prediction error be minimized i.e. 


zliva +1)- H(t +f- min (4.1.35) 


For example, let consider the plant and the disturbance represented by the 
following ARMAX model: 


y(t +1) =a, y(t) + bu(t) + cje(t) + e(t +1) (4.1.36) 
The prediction error is given by 


é(t+1) = y(t+ 1 - p(t +1) ; (4.1.37) 
=[-a, y(t) + bu(t) + cye(t) — y(t + D]+e(t+)) 


where the first term within the parenthesis contains all the variables available at the 
instant ¢ and the second term is the white noise at t+/ (which is independent with 
respect to all other variables at the instant ¢ as well as with respect to e(t)). 

One computes the variance of the prediction error, which we would like to 
minimize by an appropriate choice of p(t + 1). 
Using the expression 4.1.37 one gets: 


rlia +1)- H(t +DP} 
= E\- ay(t) + b(t) +ce(t)— 5+ DP f+ Ekan} (4.1.38) 
+ 2E{e(t + 1)[-a, y(t) + bult) + celt) — H(t +D} 


The third term in the right hand side of the Equation 4.1.38 is null since e(t+/), the 
white noise at ¢+/, is independent with respect to all signals at the instants ¢, ¢-/,... 


The term E k? (t+ | does not depend upon the choice of the predictor. It results 
that the choice of >(t+1) will affect only the first term, which can be only positive 


or null. The optimal value of the prediction will be the one that makes this term 
null at each instant i.e.: 


E\L a, y(t) + bult) + celt) — $(t+ DP E 0 (4.1.39) 
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From this condition one gets the expression of the optimal predictor: 
p(t t+ Door =—-a, y(t) + bult) + celt) (4.1.40) 
With this choice of the predictor, the prediction error becomes: 


e(t+ D| = y(t+1)— P(t + Dl, =e(t+1) (4.1.41) 


which is a white noise. 
Observe that: 


é(t) = e(t) (4.1.42) 
which allows to rewrite the optimal predictor as: 
p(t + Door =—a, y(t) + bu(t) + celt) (4.1.43) 


This result can be generalized for ARMAX models 4.1.29 of any order. For the 
general case the optimal predictor has the expression: 


I+D = -A (VA +B (q ult- d) + C (qet) (4.1.44) 


and one immediately concludes that the prediction error is a white noise: 


ett D| = y(t +1) — (t +1) = e(t +1) (4.1.45) 
This allows to rewrite the optimal predictor 4.1.44 under the form: 
P+D = -A (qA) + Bq ult- d) +C qet) (4.1.46) 


For the case of the multi-step optimal prediction see Equation 4.2.32 and Appendix 
B. 


4.2 Minimum Variance Tracking and Regulation 


This strategy concerns optimal controller design, ensuring a minimum variance of 
the controlled variable around the reference, in the case of systems subject to 
random disturbances. It can be applied only to discrete time plant models with 
stable zeros. 

The objective of the minimum variance tracking and regulation is to reduce the 
variance (standard deviation, mean square error) of the controlled output around 
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the reference value either for a constant value (minimum variance control) or for a 
variable value (minimum variance tracking). The effect of a minimum variance 
control is illustrated in Figure 4.13. 


minimum variance control 


Figure 4.13. Effect of a minimum variance control in the presence of random disturbances. 


The interest of the variance minimization of the controlled output clearly results 
from the output measures histogram. 

If the variance of the controlled output is large, one obtains a distribution of the 
measures having the form shown in Figure 4.14. In this case, an important 
percentage of the measured values of the controlled output is far from the reference 
value. Since in several applications a minimum value should be assured for the 
controlled output (i.e.: coat thickness, water content of paper, etc ...) one is obliged 
to set the reference to a value significantly greater than the necessary minimum. 


0 
%o reference 
A 
| 
small 
variance 
5 ea, large 
variance 
a varia 


_ 
controlled 
output 


minimum 
value 


Figure 4.14. Histograms of the controlled output 


On the other hand, if the controller reduces significantly the variance of the 
controlled output, one obtains a distribution of the measures narrowed around the 
reference. In this case, one can not only improve the quality of the product (better 
uniformity), but also reduce the reference value to approach the desired minimum 
value (see Figure 4.14). This implies, in general, a very important reduction of 
costs (see Chapter 8). 

Taking into account the definition of the variance of a random process (see 
Equation 4.1.9), it results that the objective is to compute u(t) which minimizes the 
following criterion: 
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sto) = E{[)-y" Of bs 1S [x - y`] = min (4.2.1) 
t=1 


where y(® - y*(®) represents the difference between the output and the desired value 
y* at the instant t. 

For solving this problem, disturbance models must be considered in addition to 
plant models. The structure considered is the ARMAX model which incorporates 
both the plant and disturbance models (see Section 4.1.3). Consequently, when 
identifying a system, both plant model and disturbance model should be identified, 
in order to apply this control strategy. 


4.2.1 An Example 
Let the plant and disturbance be represented by the following ARMAX model: 


y(ttL) =- a, y(t) + b; u(t) + by u(t-1)+ cı e(t) + e(t+ 1) (4.2.2) 


The reference trajectory will be y"(t+/) (it is either stored or generated by a 
dynamic model from the reference). 

The variance of the difference y(t+/) - y"(t+/) is computed, and it represents 
the performance criterion to be minimized: 


EtL) - y+) P?} = Eff-ay) + but) + byu(t-1) + cet) - y(t+D/?} 
+ Efe?(t+1)}+2Efe(tt D[-a y(t) + but) + byu(t-1) + cet) - y*(t+1)]} (4.2.3) 


The third term of the right hand side of Equation 4.2.3 is zero since e(t + 1), the 
white noise at instant ¢ + / is independent of all signals appearing at instants ¢, t- 
1,... (note that y* (t + 1) depends upon the reference r(t), r(t-1),... only, see for 
example Section 3.3. Equation 3.3.33). Of the two terms which then remain in the 
criterion given in Equation 4.2.3, E e (t + 1)} does not depend upon u(t). It 
results that the choice of u(t) will only affect the first term which can only be 
positive or zero. It follows that the minimization of the criterion 4.2.3 corresponds 
to finding u(t) such that: 


E{f[-a; y(t) + bj u(t) + by u(t-1) + c; et) -y (t+ D7} = 0 (4.2.4) 


which may be obtained by making the bracketed expression zero. The (theoretical) 
control law that results is: 


_y (tl) -cet + ay) jaz 
u(t) baba (4.2.5) 
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Introducing this expression into the plant output equation given by Equation 4.2.2, 
one obtains that: 


ptt) - "(4D = e(t+ 1) (4.2.6) 


and respectively 


y(t) -yÙ = eÀ (4.2.7) 


This leads to the following remarks: 


a) the application of the control law given by Equation 4.2.5 leads to a 
minimum variance for the difference y(f) - y(t) which becomes a white 
noise ; 

b) The controller cancels the zeros of the discrete time plant model (the zeros 
must be stable) ; 

c) e(t) can be replaced in Equation 4.2.5 by the measurable expression given 
in Equation 4.2.7. This results in the control law: 


+e Dy +D- (c-a) 
b, +boq™ 

TADY ¢+)-R@ yO) 

S(q") 


u(t) = 
(4.2.8) 


The structure of the minimum variance control law is the same as that for tracking 
and regulation with independent objectives in the deterministic case (Chapter3, 


Section 3.4) if P(g! d= Cq! ) (desired closed loop poles). 
In fact the transfer operator between y“(t+7) and y(t+/) is: 


T(q"')q'B (q"') 


5 FS = (4.2.9) 
Alq Sq )+q4 B (q )R(q ) 


Halq”) = 


In the example considered above: 


A(q!)=1+a,q! 


II 
© 


Bq) =q! Bq!) ; B" Q) =b; +b,q!' ; d 


Tq) =C()=1+e,¢! 
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Sq!) = Bq) =b, +b q! ; RG!) =rọ=c;-a; 
and one obtains: 


Tq Dq Ta a 


Hes (q7)= 
ODT +g RG) CQ’ 


(4.2.10) 


The closed loop poles are effectively defined by Cq! ) which characterizes the 
disturbance. 

In other words, an optimum choice exists for closed loop poles (regulation 
behavior), and this choice directly depends upon the zeros of the disturbance 
model. 

Finally, an optimal performance test can be carried out for controller tuning by 


means of a whiteness test applied to the sequence {y(t) - y (t)} for cases without 


time delay. In cases with a time delay of d samples at the optimum, {y(t) - yo} is 
a MA process of order d and thus the autocorrelation functions R(i) will be zero 
for indexes i > d + I (see Equation 4.2.30). 


An Interpretation of the Minimum Variance Control 
Let consider the optimal predictor for the ARMAX process given by 4.2.2: 


p(t +1) = -a y(t) + bult) +b u(t - 1) + celt) 
Let find the value u(t) that imposes 


pt+D=y (t+) 


Then one exactly obtains the expression of u(t) given by 4.2.5 and 4.2.8 
respectively. 

Thus, one can consider the minimum variance control law as obtained in two 
stages*: 


1. Computation of an optimal output predictor; 
Computation of a control law such that the output prediction be equal to 
the reference (or in general in order to satisfy a specified deterministic 
criterion). 


Note that the computation of the control law for the predictor is a deterministic 
problem as all the variables are known at the computation stage. 

This computation strategy in two stages for the control in a stochastic 
environment is very general (separation theorem). It can also be summarized as 
follows: first compute the best output prediction and afterwards consider the 


4 As in the deterministic case, it is a predictive control (see Appendix B). 


186 Digital Control Systems 


problem as a deterministic control problem, by replacing the real measured output 
with its prediction. 


4.2.2 General Case 


Taking into account the similarity with the deterministic tracking and regulation 
with independent objectives, the controller computation will be exactly the same by 
choosing: 


P(g!) = Cq’) (4.2.11) 


and this is summarized in Figure 4.15. 
The process plus the disturbance is described in the general case by: 


A(q”') y(t) =q B(q u(t) +C eC) (4.2.12) 
in which 

Aq!) =l+aq' +...+4,,q°"4 (4.2.13) 

Bq) =bg +..+b,,9°" =q B" (q) (4.2.14) 

C =le +. eng" (4.2.15) 


Note that B(q-/) must have stable zeros as well as C(q~/) that specify the closed 
loop poles. Moreover C(q”/) is always stable if the disturbance is stationary. 
The controller is given by: 


TA Dy (t+d+)-RG DYO (4.2.16) 


(i) = 
ii Sq) 


in which the reference trajectory is defined by: 


* B, (q7 
y(t+d +1) -Eaa Dy (4.2.17) 
m q 
By (Q7') = bm + Om q+ (4.2.18) 
Anq lana +a” Fos (4.2.19) 
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Figure 4.15. Minimum variance tracking and regulation 


The closed loop transfer function without 7T(q~/)) is (see Figure 4.15): 


Bea Aye gt Bq) E qv 
BR -1 -1 -(d+1) p* f -1 -1 -1 
Alq Sa )+q Bq RA ) Ca) (4.2.20) 
7 qB (q) 
B(q')C(q") 


As for tracking and regulation with independent objectives: 


Sq) = Bg) Si) (4.2.21) 
with 

Sq) =1+s qg] +.. +s yq! (4.2.22) 
and: 

Ra =n tng +r ag 4" (4.2.23) 


In order to compute R(q~) and S(q~/) the following equation must be solved: 


Aq!) Sq) + g Big!) R)= Bq!) Cg) (4.2.24) 
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Taking into account the structure of S(q~/), Equation 4.2.24 becomes: 
AG) STI) + gE Rig) =Car) (4.2.25) 


and the solution is the same as for the deterministic case, taking P(q ^) = C(q ^). 
For solving 4.2.25 the functions predisol.sci (Scilab) and predisol.m 
(MATLAB") available on the book website can be used. 
The precompensator 7(q~/) will have to compensate the closed loop poles and 
thus: 


ND = Cd (4.2.26) 
Let study the effect of the minimum variance control law, given by Equation 4.2.16 


on the error [y(2) - y“*0]. 
Equation 4.2.12 can be rewritten as: 


A(q!) yt+d+1) = B* (q) u(t) + C1) e(t+d+1) (4.2.27) 


Introducing the control law u(t) given by Equation 4.2.16 and multiplying by S(q ^ 
both sides, one obtains: 


A(q!) Sq!) y(t+dt1) = Bq!) C(q!) y"(ttd+1) + 
- ED) BG!) RG )y(ttdt1)+ Sq!) Cg!) e(t+d+1) (4.2.28) 


Regrouping the terms in y(t+d+/) and considering Equations 4.2.24 and 4.2.21, 
Equation 4.2.28 becomes: 


BY!) Cla!) yitrde]) = B*( 1) Cla!) y"(trd+]) + 
+ Sq!) Bg!) C(q!) e(t+d+ 1) (4.2.29) 


and dividing by B*(q~/) C(q-) one obtains: 


y(ttdt1) -y*(t+d+1) = Sq!) e(t+d+1) (4.2.30) 


in other words, the tracking (or regulation) error is a MA process of order d (for 
d=0, [y(t+d+1) - y*(t+d+1)] is a white noise). 

This corresponds to the minimization of the variance of the error [y(® - y"(4)]. In 
fact, using Equation 4.2.25, it is possible to write: 


Cig!) yt+d+1) = [A Sq!) + gV RAD] yt+d+1) (4.2.31) 
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Taking into account also Equation 4.2.27 and dividing by C(q~) both sides, one 
obtains5: 


-ùi rlyoty al 
yű+d+1) -26 2v0 +24 af luasg e(t+d+1) (4.2.32) 
Ca ) Ca ) 


from which it results: 


Elbe td+1)-y*(t+d3 »]}- 


S(q') 
Cg) 


2 
u(t)—y (t+d 4 » 
(4.2.33) 


+ E{[s@" jet +d +1) ‘| 


-1 -1 
DE dw) , Sia de) y (t+d4 0] beraea on} 


Cq”) Cq) 


The third term of the right hand side member will be zero since S(q~“) e(t+d+1) 
contains e(t+/), e(t+2).....e(t+d+/), which are all independent of (4), y(+-J),..., 
u(t), u(t-1) ... y"(ttd+1), y"(t+d).... The second term does not depend on u(t) and, 
finally, by using the control law given by Equation 4.2.16 with T(q/) = C(q/), the 
first term of the second member is zero, which corresponds to the minimization of 
the variance of [vÀ - y*0]. 

Note that Equation 4.2.30 allows a practical test for the optimal tuning of a 
digital controller to be defined, if the time delay d is known, since in this case the 
error must be a moving average of order d. Defining: 


N 
R(i) = > bo = yo} ba ~i)-y"(t-d] i=0,1,2,... (4.2.34) 
t=l 


and RN(i) = R(i)/R(0) respectively, one theoretically must obtain for large N: 
RNG) 0 izd+1 (4.2.35) 
In practice, based on finite length data, one considers as an acceptable value: 


|RN(i)| < 2.17/|N_ ; ižd+]1 (4.2.36) 


5 The optimal prediction vt +d +1) is given by the first two terms of Equation 4.2.32. 
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where JN is the number of samples used for computing RN(i) (for N = 256, RN(i) 
<0. 136,12 d+ 1). 

For more details on independence tests with finite length data see also Chapter 
6, Section 6.2. 

Finally, we remind that this design method only applies to plants having 
discrete-time models with stable zeros since the controller cancels the plant zeros. 
In the case of a discrete time plant model with unstable zeros one uses: 


— either an approximation of the minimum variance tracking and regulation 
control law using the pole placement with a particular choice of the desired 
closed loop poles; 

— ora control law based on a criterion that introduces a weight on the control 
signal energy. 


Auxiliary Poles 
In some applications the poles corresponding to C(q~) can be too fast with respect 
to the open loop system dynamics. This can lead to an unacceptable stress on the 
actuator or to unacceptable robustness margins. In this case, one can either use 
generalized minimum variance tracking and regulation design (see below Section 
4.3), or add auxiliary poles. 

If one chooses to add additional poles, the polynomial defining the desired 
closed loop poles becomes: 


PG!) = Cg!) Peg!) 


where Pp (q-/) represents the polynomial corresponding to the additional poles. 
This corresponds to the polynomial P(q~/) to be used in Equation 4.2.25 instead of 
C(q/) and in this case, consequently, T(q/) = C(q!) Pq"). 

This modification corresponds to minimize the variance of the regulation error 
filtered by Pp (q-/), i.e.: 


min E §[Pr(q) [(t+d+1) - y“(t+d+1)]]2} 


4.2.3 Minimum Variance Tracking and Regulation: Example 


The considered plant model is the same as the one used for the tracking and 
regulation with independent objectives in Section 3.4.4 (the desired tracking 
performance is also the same). The results of the minimum variance tracking and 
regulation design are summarized in Table 4.1. 
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Table 4.1. Minimum Variance Tracking and regulation 
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Plant: 
e d=0 
© Bg) =0.2¢!+01¢q7 
© Ag)= 1-13q¢1+042q7 
Tracking dynamics > T, = 1s, wg = 0.5 rad/s, C= 0.9 
e By, = +0.0927 +0.0687 q1 
© A, =1- 1.2451 q1 + 0.4066 q? 


Disturbance polynomial > OCES = ] -1.34 ql + 0.49 q? 
Pre-specifications: Integrator 


*** CONTROL LAW *** 
Sg) u(t) + RG) VO = Tg!) y"(t+d+ 1 
(q°) ut) + RG") VO) = Ma )y (t ) 


yttdt]) = [B pT D/A D]. ref) 
Controller: 


© Rg!) = 0.96 - 1.23 q1 + 0.42 q2 

© Sq) =0.2-0.1g1-0.1 47 

© W)=cq)) 
Gain margin: 2.084 Phase margin: 61.8 deg 
Modulus margin: 0.520 (- 5.68 dB) Delay margin: 1.3 s 


The controller design results for R(q7/) and S(q~/) are given in the lower part of 
Table 4.1. Before starting the simulation, the variance and mean value of the white 


noise generating the disturbance (through the filter Cq! YA! )) must be 


specified. 


The simulations results shown in Figure 4.16 illustrate the operation of the 
minimum variance controller in regulation and tracking. One can see that 


introduction of the controller effectively reduce the variance of the output. 
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Figure 4.16. Minimum variance tracking and regulation 


4.3 The Case of Unstable Zeros: Approximation of the Minimum 
Variance Tracking and Regulation by Means of Pole Placement 


4.3.1 Controller Design 


First remember that minimum variance tracking and regulation for the case where 
the zeros of the plant model are inside the unit circle (asymptotically stable zeros) 
is equivalent to a pole placement design with: 


Pq’) =B (q Ca) (4.3.1) 


(see Equations 4.2.20 and 4.2.24). 

In the case where B*(q™") contains unstable zeros, we will apply pole 
placement design but replacing the unstable zeros of B*(q') by stable 
approximations. 


For this, one first factorizes the polynomial B* u” under the form: 


B’(q')=B*(q')B (q') (4.3.2) 
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where Bt(q') contains all the zeros of B*(q"') which lie inside the unit circle 
(asymptotically stable zeros) and B (q) contains all the zeros of eC ae 
located outside the unit circle (unstable zeros). The factorization is done such that 
the coefficient of the highest power q ™ of the polynomial B™ (q) is equal to 1. 

Let define the reciprocal polynomial of B~(q™), the polynomial which is 
obtained by inverting the order of the coefficients and which will be denoted 
B q’) . This monic polynomial will have all the zeros inside the unit circle. 


Example: 
B(q'')=05+q"'; Bo'(q7) =1+0.5q7! 


B(q"') has a zero at 2+j0 (outside the unit circle) and B-\(q"') has a zero at 
0.5+j0 (inside the unit circle). 

Observe that B™'(q7') is a good approximation of B-(q"') in the frequency 
domain since: 


B~ (e?) 
B` (e72) 


=1 forall æ (4.3.3) 


This can be easily verified for the example considered above. In this case one 
has: 


5 2 
B- (eI?) 
B (ef?) 


_ 1.25 + cos œ 
1.25 + cos œ 


=1 forall æ 


The approximation of the minimum variance tracking and regulation is obtained by 
applying the pole placement design for: 


P(g) = B* (qB q CA) 


1 1 d+) p*;_-l 1 (4.3.4) 
= Aq S(q 7) +q B* (qR) 


Taking in account the structure of B (q) (given in Equation 4.3.2) it results that 
S (q"') will have the form: 


Sq’) =B (qS (q) 


and therefore S` (q) and R(q') are solutions of the equation: 
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B (qC) = AGS (q) +g PB (q RQ") (4.3.5) 
Polynomial T (q"') is given by: 


T(q')=B\(q')C(q"')/B() (4.3.6) 


For a proof of the optimality of this stochastic control law see (Astrom, 
Wittemmark 1997)’. 


4.3.2 An Example 


Table 4.2 give the results of the design for the approximation of the minimum 
variance tracking and regulation by the pole placement. 


Table 4.2. Approximation of minimum variance tracking and regulation design by means of 
the pole placement 


Plant: 
e d=0 
© Bg!) =0.1g!+024¢7 
e Ag!) = 1-13 g1 +0427? 
Tracking dynamics > T, = 1s, wg = 0.5 rad/s, C= 0.9 
© Bm = +0.0927 +0.0687 q1 
èe Any =1- 1.2451 g1 + 0.4066 q? 


Regulation dynamics > P(g!) =(1+0.5 gha - 1.34 git 0.49 q?) 
Pre-specifications: Integrator 


*** CONTROL LAW *** 
STO ult) + RQ) vO) = Tg) y t+d+1 
(T UÀ + RG YVA = TT )y (t ) 


y(ttdt 1) = [Bm GVAm GO 
Controller: 
e Rg!) = 4.813 - 6.118 q1 + 2.055 q? 
© S(q4) = 1- 0.02139 g1 - 0.9786 q? 
e Mg!) =- 280g! - 0.6 q? + 0.8166 ¢3 
Gain margin: 2.082 Phase margin: 58.5 deg 
Modulus margin: 0.520 (- 5.69 dB) Delay margin: 1.42 s 


6 The idea of this method can be used also in a deterministic context if we would like a better 
approximation of the tracking and regulation with independent objectives by the pole placement when 
the plant model has unstable zeros. 
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The plant model has an unstable zero. For defining the desired closed loop poles 
one should first factorize B KCHDS) : 


B’(q'!)=0.14+0.2g7! =0.2(0.5+9')=B*(q')B (q') 
So 
B(q')=0.5+q = B(q™')=14+0.5q" 


The disturbance model C(q~') is the same as the one used in the example 4.2.3 
and the controller is computed using Equations 4.3.4 and 4.3.5. 


4.4 Generalized Minimum Variance Tracking and Regulation 


The minimum variance tracking and regulation strategy only applies to plants 
having a discrete-time model with stable zeros. 

The generalized minimum variance tracking and regulation strategy is an 
extension of the minimum variance control strategy to plants having discrete-time 
models with unstable zeros. This method computes a control u(t) which minimizes 
the following criterion: 


2 
* O(q"') 
E td+l td+l1)4 
[r )-y @+d+1) C uo 


(4.4.1) 
i oq") |) _., 
z D td+1)-y erdan Uuo] = min 
i=l 
in which 
=Í 
gg j= (4.4.2) 
l+aq 


and C(q~) characterizes the disturbance in the ARMAX model of the plant output. 
In the case where æ = 0, the criterion of Equation 4.4.1 is written as: 


2 
“luo u(t—l)]—y (t+d+1)| += min (4.4.3) 


E td+1)4 
y(t are 
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The quantity y(¢+d+1) + [A/C(q d] [u(d) - u(t-1)] is interpreted as a generalized 
output, and its variations around y*(t+d+1) will be minimized. 

For A= 0, this strategy corresponds to the minimum variance tracking and 
regulation. For A > 0, the variance of the difference between the generalized output 
and the reference trajectory y* will be minimized but this will no more assure the 
minimization of E{[)(t+d+1) - y*(t+d+1)]2} and for this reason a small value of 4 
assuring however the stability of the closed loop is desirable in practice. 

Note also that A has a weighting effect upon the variations of u(t) and therefore 
it can be used even in the case of plant models with stable zeros in order to reduce 
the control signal variation (and then the stress on the actuator). 


4.4.1 Controller Design 


Using Equation 4.2.33, the following expression is obtained for criterion 4.4.1: 


2 
. oq") 
E d+l)- d+l 
pe +1)-y (t+d+1)+ uo) 


2 
Rq”) Sq") oq") x 
=E d+1 4.4.4 
Ea y(t) + CQD u(t) + CD u(t)—y (t+d+ ) ( ) 


+ zl [sg et+d+ of } 


To minimize this criterion, u(t) must be chosen such that the first term of the 
right hand side is zero. One thus obtains: 


Cy +d +D- RUDNA (4.4.5) 


()= 
i S(q)+0q7) 


Controller design is carried out in two stages. 

The first stage consists of computing the polynomials R(q~“), S(q~“) and T(q~/) 
= C(g') for O(q-!) = 0 by the minimum variance tracking and regulation method 
even if B(q~/) has unstable zeros. 

The second stage is to introduce the polynomial O(q~/) given by Equation 4.4.2 
with 4 > 0. Using Equation 4.4.5, the closed loop transfer operator from the 
reference trajectory to the output is given by: 


E q “Bq')T(q') 

ATTDIS + Og) +q PB (gd RG) 
7 q’ Bq) 

ATDOT) +B TCA) 


Ho 
(4.4.6) 
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since from Equation 4.2.24, one has 
AG!) Sq!) + OY BY) RG) = Bg) Cig!) (4.4.7) 


One chooses A (smaller than 1, as a general rule) and one checks that the 
polynomial [(A(q~/) QO(q 7) + B*(q-/) C(q-!)] defining the closed loop poles is 
asymptotically stable. If this is not the case, the value of 47 is changed. 

As initial choice, in the case of unstable roots of B*(q~/), one takes the lowest 
values of A allowing to obtain a stable polynomial S(q/) + O(q-/) for a=0 (since 


S(q!) = B*(¢!) Sq”) is unstable). This makes the controller stable. 

Note that the main limitation of this technique is that the existence of A leading 
to a stable closed loop system is not guaranteed (especially in the case of several 
unstable zeros) whereas with the design illustrated in Section 4.3 one always 
obtains an asymptotically stable closed loop system. 


4.5 Concluding Remarks 


In this chapter the design of digital controllers in the presence of random 
disturbances has been considered. Many of the random disturbances encountered in 
practice may be modeled as a gaussian discrete-time white noise passed through a 
filter. The knowledge of this filter called the disturbance model allows the 
disturbance to be completely characterized (with the approximation of a scaling 
factor). 

For the design of digital controllers in the presence of random disturbances one 
considers a joint plant and disturbance model called ARMAX (autoregressive 
moving average with exogenous input) model: 


q Bq) 
Aq") 


(q') 
= 


(1 
@y 


Cc 
y(t) u(t) + P 


where y is the plant output, u is the plant input and, and e is a discrete-time white 
noise sequence. The first term represents the effect of the plant input and the 
second term represents the effect of the disturbance upon the plant output. 

The ARMAX model is often written in the form: 


AID YO = 4 Big!) ut) + CAI) e0 


The Minimum Variance Tracking and Regulation control strategy minimizes the 
criterion: 


7 This technique can be also used in the deterministic case when the zeros of the plant model are 
unstable. 
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E {[y(t+d+J) - y*(t+d+1)]?} = min 


where y* is the desired output trajectory. This control strategy applies to plants 
models with stable zeros. 

The poles of the closed loop system are the zeros of polynomial C(q~/) 
characterizing the stochastic disturbance model, with the addition of the zeros of 
polynomial B*(q/). The obtained controller is identical to the controller 
corresponding to tracking and regulation with independent objectives design used 
in a deterministic environment if the polynomial P(q~/), defining the desired closed 
loop system poles, is chosen equal to C(q~/). Note that, in some cases, in order to 
reduce the stress on the actuator or to improve the robustness margins, auxiliary 
poles should be added to those imposed by C(q~/). 

In the case of a plant model with unstable zeros one chooses: 


e either an approximation of the minimum variance tracking and regulation 
control law using the pole placement ; 

e ora control law based on a criterion that introduces a weight on the control 
signal energy. 


The Generalized Minimum Variance Tracking and Regulation control strategy is 
an extension of the Minimum Variance Tracking and Regulation control strategy 
for the case of a plant model with unstable zeros. This strategy minimizes the 
criterion: 


2 
E [pean A [u(t)—u(t—-)] yesasn] = min 
Clq ) 


where 4 (> 0) is chosen such that the resulting closed loop system poles are 
asymptotically stable. Note that 4 has the effect to weight the variations of u(t). It 
can also be used to smooth the variations of the control signal resulting from a 
minimum variance control design. However, since a value of / that stabilizes the 
closed loop system may not always exist, the approximation of the minimum 
variance tracking and regulation by pole placement is recommended. 

Regardless to the method used, in the final stage of the design it is required to 
verify the resulting sensitivity functions and the corresponding robustness margins. 
If these are not satisfactory, modifications should be done (see Chapter 3) because, 
in practice, one cannot use controllers leading to insufficient robustness margins or 
imposing an excessive stress on the actuator in the frequency regions where the 
gain of the model is low (leading to large peaks on the input sensitivity functions). 
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methods called « one step ahead predictive control » (more exactly d+J steps). 
There also exist multi-step predictive control techniques (generalized predictive 
control). See Appendix B as well as: 


Landau I.D., Lozano R., M’Saad M. (1997) Adaptive Control, (Chapter 7), 
Springer, London, UK. 

Camacho, E.F., Bordons, C. (2004) Model Predictive Control, 2nd edition, 
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System Identification: The Bases 


In this chapter the basic principles of identification of dynamic systems are first 
introduced. This is followed by a presentation of the main types of parameter 
adaptation algorithms used in recursive identification methods. The choice of input 
signals for identification and the influence of disturbances is also discussed. The 
last section presents the general structure of recursive identification methods. 


5.1 System Model Identification Principles 


Identification means the determination of the model of a dynamic system from 
input/output measurements. The knowledge of the model is necessary for the 
design and the implementation of a high performance control system. 

Figure 5.1 sums up the general principles of controller design. In order to 
design and tune a controller correctly, one needs: 


1. To specify the desired control loop performance and robustness 

2. To know the dynamic model of the plant to be controlled (also known as 
the control model) which describes the relation between the control 
variations and the output variations 

3. To possess of a suitable controller design method enabling to achieve the 

desired performance and robustness specifications for the corresponding 
plant model 
The notion of the mathematical model of a system or phenomenon is a 
fundamental concept. In general, a multitude of model types exist, each one 
dedicated to a particular application. 

For example, the knowledge type models (based on the laws of physics, 
chemistry, efc...) permit a fairly complete system description and are used for plant 
simulation and design. These models are in general extremely complex and can 
only rarely be directly used for the design of control systems. The dynamic control 
models that give the relation between the input and output variations of a system 
are, as indicated above, the type of model suitable for the design and tuning of 
control systems. 
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Figure 5.1. Controller design principles 


Although indications concerning the structure of these control models can be 
obtained from the structure of the knowledge type model, it is in general very 
difficult to determine the significant parameter values from these models. This is 
why in the majority of practical situations, it is necessary to implement a 
methodology for direct identification of these dynamic (control) models from 
experimental data. 

Note that there are two types of dynamic models: 


1. Non-parametric models (example: frequency response, step response) 
2. Parametric models (example: transfer function, differential or difference 
equation) 


Henceforward we shall be concerned with the identification of sampled discrete- 
time parametric dynamic models, which are the most suitable for the design and 
tuning of digital control systems. 

System identification is an experimental approach for determining the dynamic 
model of a system. It includes four steps: 


1. Input/output data acquisition under an experimentation protocol 

2. Selection or estimation of the “model” structure (complexity) 

3. Estimation of the model parameters 

4. Validation of the identified model (structure and values of the parameters) 


A complete identification operation must necessarily comprise the four stages 
indicated above. The specific methods used at each stage depend on the type of 
model desired (parametric or non-parametric, continuous-time or discrete-time) 
and on the experimental conditions (for example: hypothesis on the noise, open 
loop or closed loop identification). The validation is the mandatory step to decide 
if the identified model is acceptable or not. 
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As there does not exist a unique parameter estimation algorithm and a unique 
experimental protocol that always lead to a good identified model, the models 
obtained may not always pass the validation test. In this case, it is necessary to 
reconsider the estimation algorithms, the model complexity or the experimental 
conditions. System identification should be then considered as an iterative 
procedure as illustrated in Figure 5.2. 

We now present a brief sum-up of the essential elements that characterize the 
different steps of the identification. 


Input/Output Data Acquisition with an Experimental Protocol 
One should essentially select an excitation signal with a rich frequency spectrum in 
order to cover the bandwidth of the plant to be identified, but with small magnitude 
(since in practice, the accepted magnitude variations of the input signals are 
strongly constrained). 

This aspect will be discussed in details in Section 5.3 and 7.2. 


Selection or Estimation of the Model Complexity 

The typical problem encountered is to define the orders of the polynomials 
(numerator, denominator) of the pulse transfer function that represents the plant 
model. 

One often uses trial and error procedures, but valuable techniques for 
complexity estimation of models have been developed (see for example Duong and 
Landau 1996). 

These aspects will be discussed in Section 6, Section 6.5 and in Chapter 7, 
Section 7.3. 


Model Parameter Estimation 

The “classic” identification methodology used to obtain parametric models based 
on non-parametric models of the type “step response” is illustrated in Figure 5.3. 
This methodology, initially used to obtain continuous time parametric models, has 
been extended to the identification of discrete time models. 

From the shape of the plant step response, one selects a type of model and the 
parameters of this model are graphically determined. As the sampling frequency is 
known, one can obtain the corresponding discrete time model from conversion 
tables. 

This methodology has several disadvantages: 


e Test signals with large magnitude (seldom acceptable in the industrial 
systems) 

Reduced accuracy 

Bad influence of disturbances 

Models for disturbances are not available 

Lengthy procedure 

Absence of model validation 
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Figure 5.2. System identification methodology 


The availability of a digital computer permits the implementation of algorithms 
that automatically estimate the parameters of the discrete time models. It should be 
emphasized that the identification of the parametric discrete time models allows to 
obtain (by simulation) non-parametric models of the step-response or frequency- 
response type, with a far higher degree of accuracy with respect to a direct 
approach, and using extremely weak excitation signals. The identification of 
parametric sampled data models leads to models of a very general use and offers 
several advantages over the other approaches. 

High performance identification algorithms, which have a recursive 
formulation tailored to real-time identification problems and to their 
implementation on micro-computer, have been developed. The fact that these 
identification methods can operate with extremely weak excitation signals is a very 
much appreciated quality in practical situations. 

The parameter estimation principle for discrete time models is illustrated in 
Figure 5.4. A sampled input sequence u(t) (where t is the discrete time) is applied 
to the physical system (the cascade actuator-plant-transducer) by means of a 
digital-to-analog converter (DAC) followed by a zero order hold block (ZOH). The 
measured sampled plant output y(t) is obtained by means of an analog-to-digital 
converter (ADC). 

A discrete-time model with adjustable parameters is implemented on the 
computer. The error between the system output y(t) at instant ¢, and the output (¢) 
predicted by the model (known as the prediction error) is used by a parameter 
adaptation algorithm that, at each sampling instant, will modify the model 
parameters in order to minimize this error on the basis of a chosen criterion. 
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Figure 5.3. “Classic” identification methodology 


The input is, in general, a very low level pseudo-random binary sequence 
generated by the computer (sequence of rectangular pulses with randomly variable 
duration). Once the model is obtained, an objective validation can be made by 
carrying out statistical tests on the prediction error ¢(¢) and the predicted output 
y(t) . The validation test enables the best model to be chosen (for a given plant), 


i.e. the best structure and the best algorithm for the estimation of the parameters. 
Finally, by computing and graphically representing the step responses and the 
frequency response of the identified model, the characteristics of the continuous- 
time model (step response or frequency response) can be extracted. 
This modern approach to system model identification avoids all the problems 
related to the previously mentioned “classical” methods and also offers other 
possibilities such as: 


e Tracking of the variations of the system parameters in real time allowing 
retuning of controllers during operation 

Identification of disturbances models 

Modeling of the transducer noises in view of their elimination 

Detection and measurement of vibration frequencies 

Spectral analysis of the signals 
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Figure 5.4. Principle of model parameter estimation 


One of the key elements for implementing this system model identification 
approach is the parameter adaptation algorithm (P.A.A.) that drives the 
parameters of the adjustable prediction model from the data collected on the 
system at each sampling instant. This algorithm has a “recursive” structure, i.e. the 
new value of the estimated parameters is equal to the previous value plus a 
correction term that will depend on the most recent measurements. 

A “parameter vector” is defined, in general, as the vector of the different 
parameters that must be identified. All the parameter adaptation algorithms have 
the following structure: 


| New parameters Old parameters 
estimation =| estimation |+ 
(vector) (vector) 
| Adaptation] [Measurement] | Error prediction 
Gain x| function |x function 


| (matrix) (vector) (scalar) 


The measurement function vector is also known as the “observation vector”. 

Note that non-recursive parametric identification algorithms also exist (which 
process as a one block the input/output data files obtained over a certain time 
horizon). Recursive identification offers the following advantages with respect to 
these non-recursive techniques: 


e Obtaining an estimated model as the system evolves 

e Considerable data compression, since the recursive algorithms process at 
each instant only one input/output pair instead of the whole input/output 
data set 

e Much lower requirements in terms of memory and CPU power 

e Easy implementation on microcomputers 
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e Possibility to implement real-time identification systems 

e Possibility to track the parameters of time variable systems 
Section 5.2 introduces the main types of parameter estimation (identification) 
algorithms in their recursive form. The effect of the noise on the parameter 
estimation algorithms will be discussed in Section 5.4. 


Model Validation 

Different points of view can be considered for the choice of a model validation 
procedure. The goal is to verify that the output model excited by the same input 
applied to the plant reproduce the variations of the output caused by the variations 
of the input regardless the effect of the noise. Techniques for model validation will 
be presented in Chapter 6 (Section 6.2 and 6.4). 


5.2 Algorithms for Parameter Estimation 


5.2.1 Introduction 


We will illustrate the principles of parametric identification presented in Figure 5.3 
by an example. 
Consider the discrete-time model of a plant described by 


y(t +1) = -a y(t) + b (u(t) = 67 A(t) (5.2.1) 
where a, and b; are the unknown parameters. 


The model output can be also written under the form of a scalar product 
between the unknown parameter vector 


6" =[a,,b,] (5.2.2) 


and the vector of measures termed measurement vector or plant model regressor 
vector 


g(t)" =A] (5.2.3) 


This vector representation is extremely useful since it allows easy consideration of 
models of any order. 

Following the diagram given in Figure 5.4, one should construct an adjustable 
prediction model, which will have the same structure as the discrete-time model of 
the plant given in Equation 5.2.1: 


P +D = H(t+ OO) = -â OVO + b Qu = OO GO (5.2.4) 
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where }°(t+1) is the predicted output at the instant ¢ based on the knowledge of 


the parameters estimated at time t (â (t), b (t)). 9° (t+1) is called the a priori 
prediction. In Equation 5.2.4 


A(t)" =[4,(1),5, (0) (5.2.5) 


is the vector of estimated parameters at time t. 
One can define now the prediction error (a priori) as in Figure 5.4: 


e°(t+l) = y0 +D- +D = €° (t+ LOD) (5.2.6) 


The term ° (t +1) is effectively computed between the sampling instants ¢ and t+/ 
once A(t) is available, ¢°(t+1) is computed at the instant t+/ after the acquisition 


of y(t+1) (between ¢+/ and t+2 ). Note that ¢° (t +1) depends on A(t) : 


Now it will be necessary to define a criterion in terms of the prediction error, 
which will be minimized by an appropriate evolution of the parameters of the 
adjustable prediction model, driven by the parameter adaptation algorithm. Since 
the objective is to minimize the magnitude of the prediction error independently of 
its sign, the choice of a quadratic criterion is natural. A first approach can be the 
synthesis of a parameter adaptation algorithm which at each instant minimizes the 
square of the a priori prediction error. This can be expressed as finding an 


expression for A(t) such that at each sampling one minimizes 


2 a 12 
J(t+1)= lea + | = leeq + 1,6(0)| (5.2.7) 
The structure of the parameter adaptation algorithm will be of the form 
A(t +1) = A(t) + A Ôl +1) = A(t) + HCO ORA (t+ 1)) (5.2.8) 


The correction term f (40, (t), £” (t+ D) should only depend upon the information 


available at the instant £++7 (last measurement y(t+1), parameter vector A(t) and a 


finite number of measurements or information at t, t-1,..., t-n ). The solution to this 
problem will be given in Section 5.2.2. A recursive adaptation algorithm will be 
derived enabling both on-line and off-line implementation. 

The criterion of Equation 5.2.7 is not the only one step ahead criterion which 
can be considered and this aspect will also be discussed in Section 5.2.2. 

When a set of input/output measurements over a time horizon ¢ (i=/, 2,..., f) is 
available, and we are looking for an off line identification, one may ask how to use 
this set of data optimally. The objective will be to search for a vector of parameters 
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A(t) using the available data up to instant ¢ and that minimizes a criterion of the 


form 
: a J2 
w+ => era âo] (5.2.9) 
i=l 
that means the minimization of the sum of the squares of the prediction errors over 
the time horizon t. This point of view will lead to the least squares algorithm which 
will be presented in Section 5.2.3 (under the non-recursive and recursive form). 
5.2.2 Gradient Algorithm 
The aim of the gradient parameter adaptation algorithm is to minimize a one step 
quadratic criterion in terms of the prediction error (one-step ahead). 


Consider the same example as in Section 5.2.1. The discrete time model of the 
plant is expressed by 


y(tt Ll) =-a, yt) +b ut) = F gt) (5.2.10) 
where 

d = fa, b] (5.2.11) 
is the parameter vector and 


ADT = [- yO), uÀ] (5.2.12) 


is the vector of measures (pant model regressor vector). 
The adjustable prediction model (a priori) is described by 


F(t +1) = PEIO) = -â Oy) + b (Quid) = A)" AA (5.2.13) 


where y (ttl ) represents the a priori prediction depending on the values of the 
parameters estimated at instant ¢ and 


A(t)" =[4,(1),5,(0)] (5.2.14) 


is the estimated parameter vector’. 
The a priori prediction error is given by 


1 Tn this case the predictor regressor vector is identical to the measurement vector. 


210 Digital Control Systems 


e° (t+) = y(t+)—$°(t+) (5.2.15) 


To evaluate the quality of the new estimated parameter vector Ot +1), which 


will be provided by the parameter adaptation algorithm, it is useful to define the a 
posteriori output of the adjustable predictor, which corresponds to re-computing 
Equation 5.2.13 with the new values of the parameters estimated at f+/. 

The a posteriori predictor output is defined by 


H(t +1) = H+ OC +1) = -â (t+ D y(t) + b (t+ Du) = Ot +)" AA (5.2.16) 


One also defines an a posteriori prediction error: 
elt+1)=y(t+1)-ŷ(t+1) (5.2.17) 


A recursive parametric adaptation algorithm with memory is desired. 
The structure of such an algorithm is? 


A(t +1) = A(t) + AG(t +1) = Ôt) + £(0(0).6(0.£° (t+ ») (5.2.18) 


The correction term f (60.9. E (t+ D) must only depend upon the information 


available at instant ¢+/ (last measure y(t+/), parameters of A(t) and eventually a 


finite number of information at instants ¢, t-/, t-2, ..., t-n). The correction term 
should allow one to minimize at each step the a priori prediction error with respect 
to the criterion 


min J(t-+1) = learo) (5.2.19) 
(t) 


If one represents the criterion J and the parameters a, and b, in three-dimensional 


space, one gets the form represented in Figure 5.5 ( a reversed conic surface). The 
optimum of the criterion will correspond to the bottom of the cone and the 


projection of this point on the plane â, b, will give us the optimal values of the 
plant parameters: a; and b}. It is obvious that, in order to reach as quickly as 


possible this point (the optimum of the criterion), it will be advantageous to go 
down along the steepest descent. This solution is analytically given by the gradient 
technique. 


2 Effectively, if the correction term is null, one holds the previous value of the estimated parameters. 
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The horizontal sections of the surface correspond to curves along which the 
criterion has a constant value (isocriterion curves). If one represents the projection 


of the isocriterion curves (J = const.) in the plane of the parameters a, „b, , one 
obtains concentric closed curves around the point a,, b; (the parameters of the 
plant model) which minimizes the criterion. As the value of the criterion J (= 
const.) increases, the isocriterion curves move further and further away from the 


minimum. This is illustrated in Figure 5.5. 
In order to minimize the value of the criterion, one moves in the direction of the 


steepest descent that, in the plane a, „Ê, corresponds to move in the opposite 


direction of the gradient associated to the isocriterion curve. This will lead us to a 
curve corresponding to J = const of a smaller value, as shown in Figure 5.5. 
The corresponding parametric adaptation algorithm will have the form 


. 5 a(t +1) 
A(t +1) = 6) - F 2 5.2.20 
(¢+1) =A(¢) 360 ( ) 


where F = al (a> 0) is the adaptation matrix gain (J — identity matrix) and 
0 J(t+1)/0 At) is the gradient of the criterion of Equation 5.2.19 with respect to 


ôO. 


A 


a, 


iso-criterion curve (surface) 


Figure 5.5. Principle of gradient method 
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From Equation 5.2.19, one gets 


1QG¢+)) _ E +1) o 


2 aĝ) aA) Ey) (5.2.21) 
But 

eP(t+l)=yt+-$°O+) = y+) -ÊA © (5.2.22) 
and then 

to 5-46) (5.2.23) 


By introducing Equation 5.2.23 into Equation 5.2.20, the parametric adaptation 
algorithm of Equation 5.2.20 becomes 


Ôl +1) = ÔC) + Foel (t+) (5.2.24) 


where F is the adaptation matrix gain?. Two choices are possible: 


1) F=al ; a>o 
2) F> 0 (positive definite matrix)* 


The geometric interpretation of the parametric adaptation algorithm expressed by 
Equation 5.2.24 is given in Figure 5.6. 


o(t) 


Fo(t)e(t+1) ;F=al 


Fo(t)e°(t+1) ; F > 0 


TO) 


Figure 5.6. Geometric interpretation of the gradient adaptation algorithm 


3 In equations of the form of Equation 5.2.24 the vector ¢ is generally called the observation vector. In 
this particular case it corresponds to the measurement vector. 

4 A positive definite matrix is characterized by: (i) each diagonal term is positive; (ii) the matrix is 
symmetric ; (iii) the determinants of all principal matrix minors are positive. 
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The parametric adaptation algorithm given by Equation 5.2.24 presents some 
instability possibilities if the adaptation gain (respectively a) is large (this can be 
well understood with the support of Figure 5.5). 

Let consider Equation 5.2.17 of the a posteriori error. By using Equations 
5.2.13 and 5.2.14, it can be re-written as 


e(t+l) = y(t+)—$(t41) = y+) -ÂA 6) + [6-604 nf g(t) (5.2.25) 
From Equation 5.2.24 it results that 
O(t) -ÔC +1) = -FAE (t +1) (5.2.26) 
and by also taking into account Equation 5.2.15, Equation 5.2.25 becomes 
elt+1) = £°(t+1)- g(t)" Fee? (t+) (5.2.27) 
that for F =al becomes: 
e(t+ 1 =h -ap pe? t+ (5.2.28) 


If A(t +1) is a better estimation than A(t) (which means that the estimation of the 


parameters goes in the good sense) one should get e(t +1)? < ¢°(t+1)*. Therefore 


it results from Equation 5.2.28 that the adaptation gain œ should satisfy the 
(necessary) condition 


a <2/ g(t)! o(t) (5.2.29) 


In this algorithm, in other words, the adaptation gain must be chosen as a function 
of the magnitude of the signals>. 

In order to avoid the possible instabilities, and the dependence of the adaptation 
gain with respect to the magnitude of the measured signals, one uses the same 
gradient approach but with a different criterion, which has as objective the 
minimization of the a posteriori prediction error at each step according to 


min J(t+1) =[e¢+)P (5.2.30) 
O(t+1) 


Thus one gets: 


> One can derives from Equation 5.2.28 that an optimal value for @ is @ © 1/4)" P(t). 
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1a(t+l) _ de(t +1) 
200(t+1) d6(t+1) 


e(t +1) (5.2.31) 


From Equations 5.2.16 and 5.2.17 it follows that 


ée(t+)=yv(t+)-p(t+) = y(t +1) A(t +1)" g(t) (5.2.32) 
and respectively that 

ee) 36 (5.2.33) 

0O(t +1) 


Introducing Equation 5.2.33 into Equation 5.2.31, the parameter adaptation 
algorithm of Equation 5.2.20 becomes 


A(t +1) = A(t) + Fotel +1) (5.2.34) 


This algorithm depends on e¢(¢+/), which is a function Ot +1). In order to 


implement this algorithm, it is necessary to express ¢(¢+/) as a function of 
E(tt+]): (e+ =f(6(0, KÀ, +I). 


Equation 5.2.32 can be rewritten as 


e(t +l) = v(t +D- 0AT A(t) - ee 41) = ôo MO) (5.2.35) 


The first two terms of the right side correspond to ¢°(¢+/) and, from Equation 
5.2.34, one gets 


A(t +1)- A(t) = Fae(t +1) (5.2.36) 
which allows one to write Equation 5.2.35 in the form 

elt+1) = €(t+1) - YTF dt) e (t+) (5.2.37) 
from which one derives the desired relation between ¢(t+/) and ¢°(t+1): 


2° (t+1) 
1+ g(t)’ FEA) 


elt+1)= (5.2.38) 


and the algorithm of Equation 5.2.34 becomes 
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Fote? (t+1) 
1+4)" FA) 


Ô(t +1) = A(t) + (5.2.39) 


that is a stable algorithm regardless of the gain F (positive definite matrix). The 
division by 7 + AT F øt) introduces a normalization that reduces the sensitivity 
of the algorithm with respect to F and g(t). 

The sequence of operation corresponding to the recursive estimation algorithms 
can be summarized as follows: 


1. Before t+/ : u(A, u(t-1),..., WO, y(t-1),..., Q(t), 6(t), F are available 


2. Before t+/ one computes: — FOO and y°(t +1) (given by Equation 
1+ 8A FO) 

5.2.13) 

At instant ¢+/ y(¢t+/) is acquired and u(¢+/) is applied 

4. The parametric adaptation algorithm is implemented 


pa 


a) One computes <(t+/) by using Equation 5.2.15 
b) One computes 6(¢+/) from Equation 5.2.39 
c) (Optionally) one computes ¢(t+/) 


5. Return to step 1 


5.2.3 Least Squares Algorithm 


By using the gradient algorithm, at each step ¢°(¢+1) is minimized or, more 
precisely, one moves in the steepest decreasing direction of the criterion, with a 
step update depending on F. The minimization of ¢7(¢+1) at each step does not 
necessarily lead to the minimization of 


AO 
i=l 


on a t-steps time horizon, as illustrated in Figure 5.7. In fact, in the proximity of the 
optimum, if the gain is not small enough, oscillations may occur around the 
minimum. On the other hand, in order to obtain a satisfactory convergence speed at 
the beginning, when the current estimation is theoretically far from the optimum, a 
high adaptation gain is preferable. The least squares algorithm offers, in fact, such 
a variation profile for the adaptation gain. 

The same equations, as in the gradient algorithm, are considered for the plant, 
the prediction model and the prediction errors, namely Equations 5.2.15 to 5.2.22. 

The aim is to find a recursive algorithm of the form of Equation 5.2.18 that 
minimizes the “least squares” criterion 
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b, 


ai 


Figure 5.7. Evolution of an adaptation algorithm of the gradient type 


min J(0)= 2 bo-ôo" si-n} = Le t.o) (5.2.40) 


t 
The term A(t)" øli — 1) corresponds to 


Ogli -1) = -å (1) (i -D +b Ouli-1) = shio) (5.2.41) 


This is the prediction of the output at instant i (i<r) based on the parameter 
estimate at instant ¢ obtained using ¢ measurements. The objective is therefore the 
minimization of the sum of the squares of the prediction errors. 


First, a parameter Ô must be estimated at instant t, so that it minimizes the sum 
of the squares of the differences between the output of the plant and the output of 


the prediction model over a horizon of ¢ measurements. The value of 6 (t) that 
minimizes the criterion of Equation 5.2.40 is obtained by looking for the value that 
cancels 0 J(t)/0 ADS: 


A(t) _ 
oA) 


zy Ko - A(t)" oi - lec -1)=0 (5.2.42) 


i=l 


From Equation 5.2.42, taking into account that 


la)" o@—N |G -1 = 6G -D4G-D" AW) 


6 This is the real minimum with the condition that the second derivative of the criterion, with respect to 
6 (t) is positive, that is 
IO 
PEE) 
OO(t)~ 
5.3). 


t 
= DK NG D7 >0 , as it is in general the case for t 2 dim 0 (see also Section 
i=] 
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one obtains 


t A t 
$ pi -1)g(i- D” bo =) ygi -1) 
i=l j 


i=l 


By left multiplying on the left both terms of this equation with 


-1 
t 

ža SG 9] 
i=l 


it results in 


i=l 


n t = t t 
A(t) = 2 oi -1)g(i -D| DIMGE-Y)=FOVY@Oe¢E-Y (5.2.43) 
i=l i=l j 
where 


FO” =J dG-DdG-D" (5.2.44) 


i=l 


This estimation algorithm is not recursive. In order to obtain a recursive algorithm, 


the estimation of 6 (t+/) is considered: 


O(t +1) = F(t+ DS ygi -1) (5.2.45) 
i=l 
t+1 
F+)! = Y¢i-Dei-l’ =F) + 4G" (5.2.46) 
i=l 


And one should express it as a function of ô (0): 
A(t +1) = A(t) + A(t +1) (5.2.47) 


From Equation 5.2.45 (adding and subtracting H(A" ÔH) ) one gets 


t+l i a 
LVOE-D = Y ypOPSE-D) + y+ DAA EGOS’ OD (5.2.48) 
i=l i=l 


218 Digital Control Systems 


Taking into account Equations 5.2.43, 5.2.45 and 5.2.46, Equation 5.2.48 can 
be rewritten as 


È ygi- = F(t +1) 1604+) re 


= F(t) (0) + ADIO OO) +OP +D -O HO) 
But, on the basis of Equations 5.2.46 and 5.2.15, one gets 

F0+D 10+) =F(t+)) ÂO +AA (t+) (5.2.50) 
Multiplying on the left by F(t+),one gets 

A(t +1) = A(t) + F(t +) OMe? (t+) (5.2.51) 


The adaptation algorithm of Equation 5.2.51 has a recursive form similar to the 
gradient algorithm given in Equation 5.2.24, with the difference that the gain 
matrix F (t + J) is now time varying since it depends on the measurements (it 
automatically corrects the gradient direction and the step length). A recursive 
formula for F(t + 1) remains to be provided starting from the recursive formula for 
F! (t + 1) given in Equation 5.2.46. This is obtained by using the matrix inversion 
lemma (given below in a simplified form). 

Lemma: Let F be a regular matrix of dimension (n x n) and ¢ a vector of 
dimension n; then” 


T 
Pa er 5.2.52 
(F +997) aK (5.2.52) 
From Equations 5.2.46 and 5.2.52 one gets 
T 
F(t41) = F() -, O9090_ FO (5.2.53) 


1+ g(t)" FOE) 


and, regrouping the different equations, a first formulation of the recursive least 
squares (RLS) parameter adaptation algorithm (PAA) is given by 


7 One can simply multiply both terms by F ze + oo" to verify the inversion formula. 
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A(t +1) = Ô) + F +DL (t+) (5.2.54) 
T 
Pev=F Oa" A ~ (5.2.55) 
1+ 90)’ FOJA 
e t+) = yt +) -ÂA A (5.2.56) 


An equivalent form of this algorithm is obtained by introducing the expression of 
F(t+1) given by Equation 5.2.55 in Equation 5.2.54. Then it follows that 


e° (t+1) 


— > (5.2.57) 
1+4) FOE) 


lc #1)= Aw|- F(t+)dHe° (t +1) = FOPA) 


However from Equations 5.2.15, 5.2.16 and 5.2.17, also using Equation 5.2.57, one 
obtains: 


é(t+1) = y0 +D- ÔU +N 9(1 = y(t +) -AOA -ÔU +1) - dl oe 
e(t+l Z+) 
1+¢()' FOOD) 1440" FOO 


(5.2.58) 


=6°(t+1)- (1) FOJA 


which expresses the relation between the a posteriori prediction error and the a 
priori prediction error. Using this relation in Equation 5.2.57, an equivalent form 
of the parameter adaptation algorithm for the recursive least squares is obtained*: 


A(t +1) = ÔA) + F()de(t +1) (5.2.59) 

Ft) =F) |) + deo" (5.2.60) 
FOLOS FO 

F(t+l)=F(t (5.2.61) 
CEDEO T OFOD 


8 This equivalent form is especially used to analyze and understand the algorithm. 
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y+) 610" Hl) Ede 
1+ 407 FOID 


elt+1)= 


For the recursive least squares algorithm to be exactly equivalent to the non- 
recursive least squares algorithm, it must be started at instant t} = dim gf), since 


normally Fy! given by Equation 5.2.44 becomes non-singular for t=tọ. In 
practice, the algorithm is initialized at £ = 0 by choosing 


F(0)= <I =(GDI ; 0<6<<1 (5.2.63) 


a typical value being ô= 0.001 (GI = 1000). It can be observed, from the 
expression of F(t+/)/ given by Equation 5.2.46 that the influence of this initial 
error decreases with time. A rigorous analysis (based on the stability theory - see 


Landau et al. 1997) shows nevertheless that for any positive definite matrix F(0) 
(F(0) > 0), 


lim e(¢ + 1) =0 
t>0 


The recursive least squares algorithm is an algorithm with a decreasing adaptation 
gain. This is clearly seen if the estimation of a single parameter is considered. In 
this case F(t) and g(t) are scalars and Equation 5.2.61. becomes 


F(t+1)= — n < F(t) 
1+9 FO 
The recursive least squares algorithm gives, in fact, less and less weight to the new 
prediction errors, and thus to the new measurements. 

As a consequence, this type of variation of the adaptation gain is not suitable 
for the estimation of time varying parameters, and other variation profiles must 
therefore be considered for the adaptation gain. 

The least squares algorithm, presented up to now for O(t) and ¢ (t) of dimension 
2, may be generalized to the n-dimensional case on the basis of the description of 
discrete-time systems of the form 


q Bq) 


Uo) (5.2.64) 
Alq ) 


yO= 


where 
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Alq) =+ an g (5.2.65) 
Bq) =bg +. tbn q ™ (5.2.66) 


which can further be rewritten as 


y(t+1)= -3 ae +#1-2)+ Sba -d-i+1)=074®) (5.2.67) 
i=l i=l 
where 
o7 =|ay,. dy, By.nsby, | (5.2.68) 
g(t)’ =[-y)...- y(t-ny +)),u(t—d)..u(t-—d—np +1)] (5.2.69) 


The a priori adjustable predictor is given in the general case by 
ny Np a m 
yo (t+) =-day(t+1-1) + $ bjult-d-—i+1)= JOMO) (5.2.70) 
i=l i=l 


where 

at)’ = la ORRON AONE ol (5.2.71) 
and, for the estimation of ô (ô, the algorithm given in Equations 5.2.54 to 5.2.56 is 
used with the appropriate dimension for ô (A, Kt) and FÀ. 


5.2.4 Choice of the Adaptation Gain 


The recursive formula for the inverse of the adaptation gain F(t+1 )-1 given by 
Equation 5.2.46 (or Equation 5.2.60) is generalized by introducing two weighting 
sequences A 7(t) and A(t), as indicated below: 


FEAD! = AOFO™ +A OOO" (5.2.72) 
0<4 <1 ; 0215.0) <2 ; F(0)>0 


Note that 47(t) and A(t) in Equation 5.2.72 have the opposite effect: A47) < 1 


tends to increase the adaptation gain (the gain inverse decreases), A(t) > 0 tends to 
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decrease the adaptation gain (the gain inverse increases). For each choice of 
sequences A7(t) and A(t) a different variation profile of the adaptation gain is 
found and, consequently, an interpretation in terms of the error criterion that is 
minimized by the PAA”. 

Using the matrix inversion lemma given by Equation 5.2.52, one obtains from 
Equation 5.2.72'° 


T 
F(t) =| re -ZOOO FO (5.2.73) 
AO) AO +910 FOO 
2 


Next a selection of choices for 17(t) and A(t) and their interpretations will be 


given. 


A.l: Decreasing Gain (RLS) 
In this case 


A(t)=4,=1 ; A(t) =1 (5.2.74) 


and F(t+J)~“ is given by Equation 5.2.60 which leads to a decreasing adaptation 
gain. The minimized criterion is expressed by Equation 5.2.40. 

This type of profile is suited for the identification of stationary systems (with 
constant parameters). 


A.2: Constant Forgetting Factor 
In this case 


A(th=%4 ; 0<A, <1 ; A= =1 (5.2.75) 
Typical values for 1, are: 2, = 0.95,...,0.99. 
The criterion to be minimized will be 


2 


J(t)= ya Ro -ÔA gli- | (5.2.76) 


i=l 


2 F(tt1y! given by Equation 5.7.72 can be interpreted as the output of a filter characterized by the 
pulse transfer operator Hq! =A (O/C -1 (q7!) whose input is og” : 


10 More numerically robust updating algorithms for the adaptation gain are available. See Appendix F. 
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The effect of 27 < 1 is to introduce a decreasing weighting on the past data (i < #). 
This is why 17 is known as the forgetting factor. The maximum weight is given to 


the most recent error. 
This type of profile is suited for the identification of slowly time varying 
systems'!. 


A.3: Variable Forgetting Factor 
In this case 


A(t) =A, =1 (5.2.77) 
and the forgetting factor 2, is given by 
A(t) =ApA(t-D +1-Ay 3 0< A <1 (5.2.78) 


typical values being: 4, (0) = 0.95,...,0.99 ; Ay =0.95,...,0.99 . 


Equation 5.2.78 leads to a forgetting factor that asymptotically tends towards 1. 
The criterion minimized will be 


2 


t 


t-l 
J0= >] Zau- [po -4" o@-p] (5.2.79) 


i=l | j=l 


As 4,(t) tends towards 1 for large i, only the initial data are forgotten (the 


adaptation gain tends towards a decreasing gain). 

This type of profile is highly recommended for the identification of stationary 
systems, since it avoids a too rapid decrease of the adaptation gain, thus generally 
resulting in an acceleration of the convergence (by maintaining a high gain at the 
beginning when the estimates are far from the optimum). 


A.4: Constant Trace 
In this case, 4 (f) and A,(f) are automatically chosen at each step in order to ensure 
a constant trace of the gain matrix (constant sum of the diagonal terms) 


trF(t+1) = trF (t) =trF (0) = nGI (5.2.80) 


in which n is the number of parameters and G/ the initial gain (typical values: 
GI=0,1...,4), the matrix F'(0) having the form 


11 When an excitation is not provided ( woo” =0), F@+1 yl goes towards zero (because in this case 


F(t+)7! =MFo! ,A, <1), leading to very high adaptation gains, a situation that should be 
avoided. 
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GI 0 
F(0) = (5.2.81) 


0 GI 


The minimized criterion is of the form 


t . 2 
JIO=E SCP -O" Ki -D (5.2.82) 


i=l 


in which f(¢, i) represents the forgetting profile. 

Using this technique, at each step there is a movement in the optimal direction 
of the RLS but the gain is maintained approximately constant (reinflation of the 
RLS gain). 

The values of 1 ,() and 1,(2) are determined from the equation 


T 
ihe l FO M apr (5.2.83) 
A(t) alt) + o(t)’ FOO 


by imposing the ratio æ (£) = 1,(0)/A,(d) (Equation 5.2.83 is obtained from Equation 


5.2.73). 
This type of profile is suited for the identification of systems with time varying 
parameters. 


A.5: Decreasing Gain + Constant Trace 
In this case, there is a switch from Al to A4 when 


F(t)<nG ; G=0.1to4 (5.2.84) 


where G is fixed at the beginning. 
This profile is suited for the identification of time variable systems in the 
absence of initial information on the parameters. 


A.6: Variable Forgetting Factor +Constant Trace 
In this case, there is a switch from A3 to A4 when 


trF (t) < nG (5.2.85) 


The domain of application is the same as for A 5. 
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A.7: Constant Gain (Improved Gradient Algorithm) 
In this case 


A(H=A4,=1 5 A(H=A =0 (5.2.86) 
and thus from Equation 5.2.72, it results that 
F(t+1)=F(t)=F(0) (5.2.87) 


The improved gradient adaptation algorithm given by Equations 5.2.34 or 5.2.39 is 
then obtained. 

This algorithm can be used to identify stationary or time varying systems with 
few parameters (< 3), and in the presence of a reduced noise level. 

This type of adaptation gain results in performances which are inferior to those 
provided by the Al, A2, A3 and A4 profiles, but it is simpler to implement. 


Choice of the Initial Adaptaion Gain F(0) 
The initial adaptation gain F(0) is of the form given by Equation 5.2.63, 
respectively Equation 5.2.81. 

In the absence of initial information upon the parameters to be estimated (a 
typical choice is to set the initial estimation to zero), a high initial gain (G/) is 
chosen for reasons that have been explained in Section 5.2.3 (Equation 5.2.63). A 
typical value is GZ = 1000. 

On the other hand, if an initial parameter estimation is available (resulting for 
example from a previous identification), a low initial gain is chosen. In general, in 
this case GI < 1. 

Since the adaptation gain decreases as the correct model parameter estimations 
are approached (a significant index is its trace), the adaptation gain may be 
interpreted as an index of the accuracy of the estimation (or prediction). This 
explains the choices of F(0) proposed above. Note that, under certain hypotheses, 
F(t) is effectively an index of the quality of the estimation because it represents the 


covariance of the parameter error vector ð (t) = A(t) —@ (see Landau 2001b). This 


property can give some information on the evolution of an estimation procedure. If 
the trace of F(t) is not significantly decreasing, the parameter estimation, in 
general, is bad. This phenomenon occurs, for example, when the amplitude and the 
type of the input used are not suited for the identification. The importance of the 
nature of the identification signal will be discussed in the following section. 
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5.3 Choice of the Input Sequence for System Identification 


5.3.1 The Problem 


The convergence towards zero of the prediction error e(t) does not always imply 
that the estimated model parameters will converge towards the true parameters of 
the plant model. 

This will be illustrated by an example. Let the discrete-time plant model be 
described by 


y(t +1) =—a, y(t) + byu(t) (5.3.1) 
and consider an estimated model described by 
$(t+1) =—G, y(t) + byu(t) (5.3.2) 


where y (t+/) is the output predicted by the estimated model. 


Now assume that u(t) = constant and that the parameters a,, b}, a,b, verify 
the following relation: 


bi _ by 
l+aq, 14+4 


(5.3.3) 


i.e. that the steady state gains of the plant and of the estimated model are the same, 
even if the condition b; = b, and â; =a, don’t hold. 
Under the effect of the constant input u(t) = u, the plant output will be given by 


OSES OE (5.3.4) 
l+aq, 


and the output of the estimated prediction model will be given by 


yt+D=VO= u (5.3.5) 


1 
1+å 


Therefore, considering Equation 5.3.3, it results that 


elt +1) =y(t+l—p(t+1) =0 for u(t) =const; a, #a, sb +b (5.3.6) 
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It can thus be concluded from this example that the application of a constant input 
does not allow the two models to be distinguished, since they both have the same 
steady state gain. 

If the frequency characteristics of both systems are plotted, we obtain the 
curves shown in Figure 5.8. 


G 
lant 
Pi p 


model 


me 


oO 


Figure 5.8. Frequency characteristics of two systems with the same steady state gain 


It can be observed that, in order to put in evidence the differences between the 
two models (that is, between the parameters), one must apply a signal u(‘)=sin( ot) 
(œ + 0) and not a signal u(t) = constant. 

Let us analyze this phenomenon in greater detail. When the prediction error is 
null, from Equations 5.3.1 and 5.3.2 one obtains 


e(t+l)=y(t+1-SE4+1)=0 ; -la a yn) +[, -ó lu) =0 (5.3.7) 
From Equation 5.3.1, y(¢) can be expressed as a function of u(t): 
1 


y(t) = AI ug) (5.3.8) 
l+aq 


Introducing the expression of y(t) given by Equation 5.3.8 in Equation 5.3.7, the 
following equivalent relation follows: 


[la -a big” +( ~6,\(l+ aq") lu) 


: \ (5.3.9) 
= b-b; +q ba, — a,b, u() =0 


We are concerned with finding the characteristics of u(t) so that verification of 
Equation 5.3.9. results in zero parametric errors. 
Note that 


bi =bi =Q ; bay -aby =Q, (5.3.10) 


Equation 5.3.9 can then be written as 
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(a, + aq" Ju(t) =0 (5.3.11) 


that is a difference equation having a solution of the discretized exponential type. 
Let 


u(t) =z! =e (5.3.12) 
where T, is the sampling period. Equation 5.3.11 becomes 


(a) +271a, )z' =(zay +a, )z"! =0 (5.3.13) 


and it will be verified for z, which is the solution of the characteristic equation 


Za) +a, =0 (5.3.14) 
One gets 
goo Layee o = real (5.3.15) 
ao 


and the aperiodic solution 
u(t) = e™ (5.3.16) 


leads to the verification of Equations 5.3.11 and 5.3.7 respectively, without having 
a, =a, and b = b . In practice, the signal u(t) = constant, previously considered, 
corresponds to o = 0, that is - a, = œg. However 


n a E by by 
-Q =a) > bı -bı = ah, —b,a, > —— = 
1 0 179 101 — 94) tea, 188 


In other words, if u(t) = constant, we can just identify the static gain. 


Therefore it is necessary to apply a signal u(t) such that a, =a, and b =b. 


This can be obtained if u(f) is not a possible solution of Equation 5.3.11. 
Let 


u(t) = ef?" or e JOT (5.3.17) 


Equation 5.3.11 becomes (for u(t) = es") 
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le IT oy + or | ell) _ 9 (5.3.18) 


As qj and q are real, e/@"s cannot be a root of the characteristic equation and it 
results that ¢(¢) = 0 will be obtained only if 


ay =a, =0> Í =), $ a, =a (5.3.19) 


It is this type of input which was previously proposed when the frequency 


characteristics of the two models were examined (sin œt = (e/-e/)/2/). A non- 
zero frequency sinusoid is thus required in order to identify two parameters. 

This approach for determining the input u(t) allowing satisfactory model 
parameter identification may also be applied to systems of the general form 


=> Faot- Y bed (5.3.20) 
i=l i=l 


for which the total number of parameters to be identified is: 
number of parameters = n4 + ng 


In this case u(t) can be chosen as a sum of p-sinusoids of different frequencies: 


p 
u(t) =—)>)sin@,T,t (5.3.21) 
i=l 


and the value p, allowing good parameter identification, is given by!” 


Nyt+Nnp 
NytNp= even p2—~—— 

n a +1 ere?) 
na tng= odd pz as 


In other words, in order to identify a correct model, it is necessary to apply a 
frequency rich input. The standard solution in practice is provided by the use of 
“pseudo-random binary sequences ”. 


t 
12 The condition of Equation 5.3.22 also guarantees that UG -1)g(i - iy? is an invertible 
i=l 
positive definite matrix for £ 2 n4 + ng = dim ¢(see Equations 5.2.42 to 5.2.46). 
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5.3.2. Pseudo-Random Binary Sequences (PRBS) 


Pseudo-random binary sequences are sequences of rectangular pulses, modulated 
in width, which approximate a discrete-time white noise and thus have a spectral 
content rich in frequencies. 

They owe their name pseudo-random to the fact that they are characterized by a 
sequence length within which the variations in pulse width vary randomly, but that, 
over a large time horizon, they are periodic, the period being defined by the length 
of the sequence. 


per [ez jes |e | os | 


( addition modulus 2 ) 


Figure 5.9. Generation of a PRBS of length 25-1 =31 sampling periods 


The PRBS are generated by means of shift registers with feedback 
(implemented in hardware or software). The maximum length of a sequence is 2N- 
] in which N is the number of cells of the shift register. Figure 5.9 presents the 


generation of a PRBS of length 31 = 25-1 obtained by means of a five cells shift 
register. Note that at least one of the N cells of the shift register should have an 
initial logic value different from zero (one generally takes all the initial values of 
the N cells equal to the logic value 1). 


Table 5.1. Generation of maximum length PRBS 


Number of cells Length of the sequence Bits added 
L=2N-] Bj and Bj 


255 


System Identification: The Bases 231 


Table 5.1 gives, for different numbers of cells, the structure enabling the 
generation of maximum length PRBS. 

A C™ program as well as a MATLAB" function (prbs.m) for generation of 
pseudo-random binary sequences can be found on the book website. 

Note also a very important characteristic element of the PRBS: the maximum 
duration of a PRBS pulse (tim) is equal to NT, (where N is, the number of cells and 
T, is the sampling period). This property is to be considered when choosing a 
PRBS for system identification. 


Sizing of a PRBS 

In order to identify correctly the steady state gain of the plant dynamic model, the 
duration of, at least, one of the pulses (e.g. the maximum duration pulse) must be 
greater than the rise time tp of the plant (including the time delay). The maximum 


duration of a pulse being N.7,, the following condition results: 


tim = NT, > tp (5.3.23) 


that is illustrated in Figure 5.10. 
From Equation 5.3.23, one derives N and thus the length of the sequence 20-1. 


— Ni 


tim = RN > t, 


aa Ík — 


Figure 5.10. Choice of the maximum duration of a pulse in a PRBS 


Furthermore, in order to cover the entire frequency spectrum generated by a 
particular PRBS, the length of a test must be at least equal to the length of the 
sequence. In a large number of cases, the duration of the test (L) is chosen equal to 
the length of the sequence. If the duration of the test is specified, it must therefore 
be ensured that 


2T <L ; L= test duration (5.3.24) 


Note that the condition of Equation 5.3.23 can result in fairly large values of N, 
corresponding to sequence lengths of prohibitive duration. 

This is why, in many practical situations, a sub-multiple of the sampling 
frequency is chosen as the clock frequency for the PRBS. If 


J pres = fs >; p=,2,3.... (5.3.25) 
P 
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then Equation 5.2.23 becomes 
tin = PNT, > tp (5.3.26) 


This approach is more interesting than the extension of the sequence length 
(increase of N) in order to satisfy Equation 5.3.23. Indeed, if one passes from N to 
N' =N + 1, the maximum duration of a pulse passes from NT, to (N+/)7,, but the 


duration of the sequence is doubled L' = 2L. On the other hand, if fppps = f/2 is 
chosen, the maximum duration of a pulse passes from NT, to 2NT, for a doubled 


sequence duration L’= 2L. 

From a comparison of the two approaches, it results that the second approach 
(frequency division) enables a pulse of greater duration to be obtained for an 
identical duration of the sequence and thus of the test. If p is the integer frequency 
divider, one has in the case of clock frequency division (d pax = maximum pulse 


duration) 
tin = PNT, ; L'=pL=p T, ; p=1,2,3.... 


In the case of an augmentation of the number of registers N by p-/, without 
changing the clock frequency, one gets 


tin =(N+p-DT, ; =L ; p=1,233.... 


Note that dividing the clock frequency of the PRBS will augment the spectral 
density in low frequencies (which it is desired) but will reduce the frequency range 
corresponding to a constant spectral density. 

As an example, the spectral densities of the PRBS sequences generated with 
N=8, for p=1,2,3 are represented in Figure 5.11. 

One can observe that for p>/ the signal energy is augmented at low frequencies 
but it is reduced at high frequencies. Furthermore, for p=3 there is a hole at f/3 


(the PRBS does not contain the sinusoid of frequency f/3). 


In general this will not affect the quality of the identification either because the 
plant to be identified has a reduced band pass with respect to the sampling 
frequency, or because the effect of the reduction of the signal/noise ratio at high 
frequencies can be compensated by using appropriate parameter estimation 
algorithms. However it is recommended to use p <4 (see Landau et al. 1997; 


Landau 2001b). 
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a) PRBS Spectrum: N =8, p=1 
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b) PRBS Spectrum: N =8,p=2 
T 


T T T T T T 


Magnitude (dB) 


| 

1 i i 
0.05 0.10 0.15 0.20 0.25 0.30 0. 
c) PRBS Spectrum: N = 8, p=3 
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Figure 5.11a-c. Spectral density for a PRBS: a N=8, p=1 ; b N=8, p=2 ; c N=8, p=3 


Choice of the Magnitude of the PRBS 
The magnitude of the PRBS may be very small, but it must be larger than the 
amplitude of the residual noise. If the ratio signal/noise is too small, it is necessary 
to augment the length of the test in order to obtain a good parameter estimation. 
Note that, in a large number of applications, the significant increase in the 
PRBS level may be undesirable in view of the non-linear character of the plants to 
be identified (we are concerned with the identification of a linear model around an 
operating point). 


5.4 Effects of Random Disturbances upon Parameter Estimation 


The plant measured output is in general contaminated by noise. This is due either 
to the effect of random disturbances acting at different points of the plant, or to 
measurement noises. These random disturbances are frequently modeled by 
ARMA models, the plant plus the disturbance being modeled by an ARMAX 
model (see Chapter 4, Section 4.1. for the description of random disturbances). 

These disturbances introduce errors into the identification of the plant model 
parameters when the recursive (or non recursive) least squares algorithm is used. 
This type of error is called the bias of parameters. 
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Before presenting those algorithms able to eliminate the bias on the estimated 
parameters, first let analyze the effect of the random disturbances on the least 
squares algorithm. 

Replace the plant model Equation 5.2.67 by 


y(t +1) = 0" HA + w(t +1) (5.4.1) 
where w(t) represents the effect of the measurement noise (supposed stationary, 
with zero mean value, finite variance and independent with respect to u(¢)). 


By introducing this expression of y(t) into Equation 5.2.43 one obtains for a 
number of data N 


N al N 
da=» Sree- m-n Seon (5.4.2) 


{=l t=l 


By multiplying and by dividing by N the second term of the right side one obtains 


=i 
Be 1% ie 
O(N) 04 Ly 40 Dd(t v PX wo (5.4.3) 


We are interested in the properties of ON ) when N —> œ and we would like to 
find the conditions allowing one to obtain an asymptotically unbiased estimation 


N 
( lim O(N) =0). By examining Equation 5.4.3, as lim Yee -Dee-1" is 
Nx Noo = 


supposed non-singular (the system is correctly excited — see Section 5.3), it results 
that the condition to obtain an asymptotically unbiased estimation is 


l N-1 
tim +w - mo! = E{g(t -1)w(t)} = 0 (5.4.4) 


Thus, asymptotically unbiased parameter estimation will be obtained only if 
g(t —1) and w(t) are uncorrelated. Unfortunately, this will hold only in the case in 
which w(f) = e(t) = white noise. From Equation 5.4.1 it results that y(t) depends on 
w(é) and, as a consequence, ¢(t—1), which contains y(t-1), y(t-2),..., y(t-n4 ), is a 
function of w(t-1), w(t-2), ..., w(t- na ). Therefore 


o(t—-1)" = f(w(t-1), w(t —2),..., W(t —114),---) (5.4.5) 


Equation 5.4.4 becomes 
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E\w(t-iw(i)}=0 pour i=1,2,...n, (5.4.6) 


and Equation 5.4.6 is satisfied only by white noise (see Section 4.1). 

This clearly shows that the use of a least squares algorithm will lead to an 
unbiased estimation only in the very unlikely practical situation where w(‘) = e(t) 
= white noise. 

In particular, the parameter estimation will be biased if the system “plant + 
disturbance” is modeled by an ARMAX model that is representative of many 
situations encountered in practice. 

Let 


y(t +1) =a, y(t) + but) + c,e(t) + e(t +1) 
One then gets: 


w(t) = celt —1)+ e(t); 
w(t —1) =c,e(t-2) + e(t-1) 


and 


Efw()w(t-} = Ekt -1 }+ Efe(elt -D} + ¢ Efe(t -2)e(t)} 
+ cf E{e(t —le(t —2)}= cEte(t 1? }= co’ #0 


Suppose now that the exact value 6=6 is known, and we require that the 
estimation algorithm leaves unchanged (asymptotically) the estimated value. For 


6=6 the least squares predictor equation is written as 
H(t +10) = 07 (0) (5.4.7) 
and the prediction error becomes 


elt +110) = y(t +1) — H(t +10) = w(t +1) (5.4.8) 


It thus results from Equation 5.4.4 that in order to obtain O(N )=0 when t — œ 


there is a necessary condition to be satisfied for ÔO) = 0 = const (by replacing w(t) 


with e(t,0) in Equation 5.4.4)": 


13 Notation M(t-1, 0 ) and e(t, @) indicates that these variables have been obtained with a fixed vector of 
estimated parameter @. 
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No 


N-1 
lim to -1,0)é(t, J = E{g(t-1,0)e(t,0)} =0 (5.4.9) 


To avoid bias, one needs to choose other observation vectors, other types of 
predictors and other adaptation errors in order that 


E{g(je(t+)}=0 for 0=0 (5.4.10) 


Two criteria have been retained for the generation of algorithms fulfilling the 
condition of Equation 5.4.10 and asymptotically leading to unbiased parameter 
estimations: 


1. ¢(t+/) (or Ut+/) = adaptation error) is a white noise for 6=0 
2. &t)and e(t+/) (or Kt+/)) are uncorrelated (or independent) ford =6 


It is the elimination of the bias on the estimated parameters in presence of 
disturbances that is at the origin of the development of most of identification 
methods. 


5.5 Structure of Recursive Identification Methods 


All the recursive identification methods correspond to the basic scheme given in 
Figure 5.12. 

They all use the same structure for the parametric adaptation algorithm (PAA) 
with the different possible choices for the “adaptation gain” 


A(t +1) = AO + FODA E+) (5.5.1) 


FU(t+l=AOFA) +A, 0(1)0(1)" 
0<A(t)<1;0<4,(t)<2; F(0)>0 


(5.5.2) 


e(t+) 


5.5.3 
1+0 FODA on 


elt+1)= 
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where «(t+/) and £(t+/) are the a posteriori and a priori prediction errors, 


respectively, Of) is the observation vector, F(t) is the adaptation gain and O(t) 
represents the vector of the estimated parameters. 


Disturbance 


eg y(t) 


Figure 5.12. Structure of recursive identification methods 


The different identification methods can be classified by: 


e The structure of the predictor 
e The origin of the elements of the observation vector (Ø) 
e The dimension of the adjustable parameter vector 6(r) and of the 


observation vector Dt) 
e The way to compute the prediction error and respectively the adaptation 
errors 


The convergence properties, in the presence of random disturbances, will depend 
on the different choices indicated above. 

Table 5.2 gives a compact description of the various recursive identification 
methods which will be discussed in Chapter 6. 

All these identification methods are classified in two categories, with respect to 
the criterion considered for their development (in order to obtain unbiased 
estimated parameters): 


e Identification methods based on the whitening of the prediction error (£) 
e Identification methods based on the uncorrelation of the observation vector 
(D) and the prediction error (€) (E{@(t) e (t+1)} # 0) 


Since the different methods have been developed in order to verify one of the two 
criteria mentioned above, the models identified with a particular method must be 
validated by using the corresponding criterion, used to define the objective of the 
method itself. It results that two validation techniques are available, allowing one 
to verify, according to the case, one of the two criteria. 
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If one considers in more detail the structure of the predictor and the choice of 
the observations vector, three types of methods can be distinguished: 


The equation error methods (recursive least squares and the different 
extensions: extended least squares, generalized least squares, recursive 
maximum likelihood). Each method tends to obtain a white prediction error 
(white noise) for a class of disturbance models by modeling the 
disturbance 

The instrumental variable methods (with delayed observations or with 
auxiliary model). Each method tends to obtain E{@(t) &t+/)} = 0 by the 
modification of the observation vector @(f) used in the least squares 
algorithm 

The output error methods (with fixed or adjustable compensator, with 
filtered observations, with extended estimation model). These methods tend 
to obtain asymptotically either E{ A(t) at+/)} = 0, or the whitening of the 
adaptation error by the modification of the predictor and of the method for 
obtaining the adaptation error 


Four model structures can be considered for the representation of the system 
“ plant + disturbance”. These four structures are summarized in Figure 5.13 and 
they are briefly described below. 


SI: 


Aq!) yi) = g4 Bq!) ut) + et) 


The method that can be used for this structure is: 


l: 


S2: 


Recursive Least Squares (RLS) 


AI) y4) = ¢4 Bg) ut) + Aq!) wit) 


This structure corresponds to a model of the form: 


= 
y= FE u+ we) 
Alq ) 


where w(f) is a non-modeled disturbance for which it is assumed only that it is of 
zero mean value, finite power and independent of the input. 
The methods that can be used for this structure are: 


ga bor 


S3: 


Instrumental Variable with Auxiliary Model (IVAM) 
Output Error with Fixed Compensator (OEFC) 

Output Error with Filtered Observations (OEFO) 

Output Error with Adaptive Filtered Observations (OEAFO) 


AGI) y(t) = IBI) u(t) + C(q!) et) 


The methods that can be used for this structure are: 


1. 
2. 
3: 


Extended Least Squares (ELS) 
Recursive Maximum Likelihood (RML) 
Output Error with Extended Prediction Model (OEEPM) 


System Identification: The Bases 239 


S4. A) yi) = 4 BAD u) + [/C(q))] ett) 
The method that can be used for this structure is: 


1. Generalized Least Squares (GLS) 


S1: A(q!) y(t) = qË B(q’!) u(t) + e(t) 


S4: A(q 1) y(t) = qË Bq!) u(t) + [1/C(q7]e(t) 


e(t) 


Figure 5.13. Structures of the “plant + disturbance” models 
(A(q')=1+aiq'+..., Bq')=biq' +... Cq") =1+eiq'+...) 


No single « plant + disturbance » structure exists that can describe all the 
situations encountered in practice 

In practice, it can be pointed out that structure 3 corresponds to slightly less 
than two-thirds of situations, structure 2 corresponds to approximately one-third of 
the situations, and structures | and 4 correspond to the remaining situations. 
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Note that there does not exist a unique identification method which may be used 
with all the possible « plant + disturbance » structures such that the estimated 
parameters are always unbiased. 

Since a unique “plant + disturbance” structure for describing all the situations 
that may be encountered in practice does not exist and since a unique identification 
method that always provides unbiased parameter estimations does not exist, it 
results that an interactive procedure for the system identification is required. 
Therefore a computer aided system identification software should provide: 


Different structures for the “plant + disturbance” 

Different identification methods and PAA 

Validation methods for the identified models 

A system for input/output data acquisition and processing (including the 
generation of a PRBS) 

e Tools for the model analysis 

e Tools for visualising different graphs and plots 


There are dedicated stand-alone system identification software like WinPIM* 
(Adaptech 1996a) or interactive software using MATLAB” environment like the 
System Identification Toolbox (Mathworks 1998). 

Routines corresponding to the different identification and validation methods, 
which will be presented in Chapter 6, are available in Scilab and MATLAB” 
environments (see Appendix H) and can be downloaded from the book website. 


5.6 Concluding Remarks 


Basic elements for the identification of dynamical systems have been laid down in 
this chapter. 
System identification includes four basic steps: 


1. Input/output data acquisition under an experimental protocol 

2. Selection or estimation of model structure (complexity) 

3. Estimation of the model parameters 

4. Validation of the identified model (structure and values of parameters) 


Recursive or non-recursive parameter identification algorithms can be used for 
estimating the parameter of a model from input-output data. Preference has been 
given to recursive algorithms for several reasons including: (i) estimation of the 
model as the system evolves ; (ii) less memory and computer power required ; (iii) 
real-time identification capability. 

The core of the recursive identification methods is the parameter adaptation 
algorithm (PAA) which has the form 


A(t +1) = A(t) + F(t +) Oe" (t +1) 
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where @ is the estimated parameter vector and F(t+/) DP) €°(t+/) represents the 
correcting term at each step. F is the adaptation gain (constant or time varying), ® 
is the observation vector and €° is the prediction error (or in general the adaptation 
error), i.e. the difference between the true output and the predicted one. 

Different choices are possible for the adaptation gain sequence in relation with 
the type of identification problem (constant or time varying plant parameters, with 
or without initial information, efc...). 

The uniqueness of the identified parameters depends upon the characteristics of 
the input signal. To obtain a unique set of identified parameters, in the case of the 
identification of a plant model characterized by an irreducible transfer function, the 
input signal should contain a number of distinct sinusoidal components superior to 
half of the number of parameters to be identified. In practice, one systematically 
uses as input for system identification the pseudo-random binary sequences 
(PRBS), which approximates a discrete-time white noise. 

The stochastic disturbances which contaminate the measured output may cause 
bias in the parameter estimations. For specific types of disturbances appropriate 
recursive identification methods, providing asymptotically unbiased estimations, 
are available. 

The different recursive identification methods available use the same structure 
for the PAA. They can be distinguished by: 


1. The structure of the predictor 
2. The origin of the elements of the observation vector (®) 


The dimension of the adjustable parameter vector ô 4) and of the 
observation vector Ø 

4. The way in which the prediction errors (or the adaptation errors) are 
generated 


These identification methods can be grouped in two categories: 


1. Identification methods based on the whitening of the prediction error 
2. Identification methods based on the uncorrelation of the observation vector 
and the prediction error 


A unique plant + disturbance structure, which describes all the situations 
encountered in practice, does not exist, as also does not exist a unique 
identification method providing unbiased parameter estimates in all the situations. 
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N.Y. 

Ljung L., Söderström T. (1983) Theory and Practice of Recursive Identification, 
MIT Press, Cambridge, Mass. 
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Landau I.D. (1990) System Identification and Control Design, Prentice Hall, 
Englewood Cliffs, N.J. 


The use of identification techniques in signal processing is discussed in several 
references among which we cite: 


Landau I.D. (1984) A Feedback System Approach to Adaptive filtering, IEEE 
Trans. on Information Theory, vol. 30, n°2, pp. 251-262. 

Landau I.D., M'Sirdi N., M'Saad M. (1986) Techniques de modélisation récursives 
pour l'analyse spectrale paramétrique adaptative, Traitement du Signal, vol.3, 
pp. 183-204. 


and also Ljung and Söderström (1983). 
The references for the software dedicated to system identification are: 


Adaptech (1996a) WinPIM’TR — System Identification Software, Adaptech, St. 
Martin d’ Heres, France. 

Mathworks (1998) System Identification toolbox for MATLAB", The Mathworks 
Inc., Mass., U.S.A. 
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System Identification Methods 


In this chapter two categories of identification methods: (1)methods based on the 
whitening of the prediction error; (2) methods based on the uncorrelation of the 
observation vector and the prediction error, are presented in their recursive form 
together with the corresponding model validation techniques. 

Methods for the model order estimation are presented in the last part of the 
chapter. 


6.1 Identification Methods Based on the Whitening of the 
Prediction Error (Type I) 


The following recursive identification methods given in Table 5.1 fall into this 
category: 


Recursive Least Squares (RLS) 

Extended Least Squares (ELS) 

Recursive Maximum Likelihood (RML) 

Output Error with Extended Prediction Model (OEEPM) 
Generalized Least Squares (GLS) 


6.1.1 Recursive Least Squares (RLS) 


The recursive least squares method has been presented in detail in Chapter 5, 
Section 5.2.3. 

The analysis in the presence of random disturbances has been presented in 
Section 5.4. It should be remembered that the recursive least squares method gives 
unbiased estimations only for “plant + disturbance” models of the form (structure 
S1) 
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Aq”) v(t) = 4 B(q u(t) + elt) (6.1.1) 


ie. for a disturbance model with C(q/) = 1 in the equation of the ARMAX 
models. 


6.1.2 Extended Least Squares (ELS) 


This method has been developed in order to identify without bias “plant + 
disturbance” models of the form (structure S3): 


Aq”) yt) = qB )u(t) + Cq Delt) (6.1.2) 


The idea is to identify simultaneously the plant model and the disturbance model, 
in order to obtain a prediction (adaptation) error, which is asymptotically “white”. 

This method will be presented by means of an example. Let the “plant + 
disturbance” model be 


y(t+ 1) =—a,y(t) + bu(t) + cye(t) + e(t + D (6.1.3) 


Assume that the parameters are known and construct a predictor, which will give a 
white prediction error 


p(t +1) = -a y(t) + bult) + celt) (6.1.4) 


Furthermore this predictor minimizes the variance of the prediction error E {[y(t+/) 
- ~ (t+1)]?} (see Chapter 4, Section 4.1.4). 
The prediction error is given by 


e(t+1) = y(t +1) -90+ =e +) (6.1.5) 


This allows to rewrite Equation 6.1.4 in the form 


Pitt) =-a y(t) + bult) + celt) (6.1.6) 
In the case of unknown parameters, the adjustable predictor will be given by 


Equation 6.1.6, in which the unknown parameters are replaced by their estimates. 
The a priori adjustable predictor will therefore take the form 


PED = -â OVO +b OUA +ê (DEW = AOT 6) (6.1.7) 


where 
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60" -aohos + d0"'=ExO.udcO] 6.1.8) 
The a posteriori adjustable predictor will be given by 
y(t +1) =a, (t+ y(t) + by (t+ Dult) +ê l+ Det) = At+1)' gt) (6.1.9) 


The a posteriori prediction error «(t+/) is expressed as 


é(t +l =y(t +1) —- p(t +) (6.1.10) 
and the a priori prediction error is defined as 
E° (+1) = yt+1) -9° (t+ (6.1.11) 


Using the adjustable predictor given by Equation 6.1.7, the formulation of the 
problem of the simultaneous identification of the plant model and of the 
disturbance model has been reduced to a least squares type formulation as 
considered in Section 5.2.3. 

The parameter adaptation algorithm (PAA) described in Section 5.5 (Equations 
5.5.1 to 5.5.3) will be used with A(t) and @(t) = (t) given by Equation 6.1.8. All 
“adaptation gain” policies may be used. 

Compared to the simple least squares method, there is a larger number of 
parameters to be estimated. ôA) includes in addition the coefficients of C(q-7). The 
observation vector will be obviously larger. It contains in addition the a posteriori 
errors £ (f), e (t-1)...e (tnctl). 

In the general case, the estimated parameters vector and the observation vector 
will be of the form 


TO =|a,()..4,,.6,00.-5,, 0.40.6, (0| 


ot)? =[- y(d)...-y(t-n4 +1),u(t-d)...u(t—d—ng +1), e(t)...e(t—nc +1] 


In the presence of a random disturbance corresponding to the ARMAX model and 
with an asymptotically decreasing adaptation gain, (£ asymptotically tends 
towards a white noise, which guarantees an unbiased estimation of the parameters 
of A(q-/), B(q“) (if the input is sufficiently rich)!. 


| The convergence of @is rigorously guaranteed within a convergence domain 


De oe — 0)” d(t,0) = o} in which 8” is the vector of true parameters. For a rich input, this 
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Nevertheless, this convergence is subject to a sufficient (but not necessary) 
condition 


-— ; 2>% 2max/,(t) (6.1.12) 


is a strictly positive real transfer function. A strictly positive real transfer function 
is characterized by the following two properties: 


1. itis asymptotically stable 
2. the real part of the transfer function is positive at all frequencies 


This concept is illustrated for continuous time systems in the upper part of Figure 
6.1 and for discrete time systems in the lower part of Figure 6.1. 


Continuous-time 


ReH<0Q ReH>0 


Discrete-time 


i z= ReH<0 ReH>0 


Figure 6.1. Strictly positive real transfer functions 


An eventual non-convergence of the method for certain values of Cq! ) and 
for certain types of input signals can be explained by the violation of this 
condition. 


domain is reduced to a single point 6". The convergence of the parameters of caq! ) is slower than that 


of Aq? ) and B(q” 1 ) parameters, and it depends on the realization of the stochastic process. 
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6.1.3 Recursive Maximum Likelihood (RML) 


This is an improved version of the extended least squares method. Instead of using 
directly øf) given by Equation 6.1.8 in the parameter adaptation algorithm, it is 


first filtered by U/C (t, q1) where Ĉ (t, q?) is an estimation at instant t of Cig). 


This modification has the effect of eliminating the positive real condition on Cq! ) 
in the final convergence stage, and of accelerating the uncorrelation between the 
observation vector and the prediction error. An example will be used to present this 
method. The “plant + disturbance” model is given by Equation 6.1.3. 

The a priori adjustable predictor is written as (similar to the ELS) 


yp (t+l) =a, (y(t) + b, (thu(t) + é,(t)e(t) = A(t)" A(t) (6.1.13) 
where 

40" =O.b0.a0] + oO" Erou] (6114 
The a posteriori adjustable predictor is written as 

E+N =OE+1)" OO) (6.1.15) 
and the corresponding prediction errors are given by 


e° (t+1)= y(t +1)- f° (t+) 


` (6.1.16) 
elt+1)= y(t +1)- y(t+1) 
The estimation of the polynomial C(q~/) at instant ¢ is written as 
t, =1+ê Aq! (6.1.17) 
The observation vector O(f) is defined by 
1 
DA)” =," = E [-»@), uA, EA] 
(tq) (6.1.18) 


-y) ut) et) 
Cinq) ĈE, qg?) Cig") 


which corresponds to the filtering of the components of øf) by // Ĉ tq’). 
The parameter adaptation algorithm is given by Equations 5.5.1, to 5.5.3, where 
(A) is now given by Equation 6.1.18. In the general case 
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60" AOE MOLA OE MOKA 0.-£, O| 


DOT =4,()" =— 1 
O =¢,() Gq) 


[yO -yatna +D,u(t-d)..u(t-—d -np +1), €(0)..e(t—ne +0] 


ng 


Nevertheless, this method cannot be implemented starting from the instant t=0 if a 
good estimation C(q~“) is not available. First an initialization horizon must be 
considered, during which the extended least squares (ELS) method is used in order 
to obtain a first estimation. As a rule, the initialization horizon is taken equal to 5 
(up to 8) times the number of the parameters to be identified. 

On the other hand, filtering of the observations can only be carried out for 


stable estimations of C (tq). A stability test must therefore be incorporated. Note 
that the transition ELS— RML should only occur if Č (t q) is stable. If at the 
end of the initialization horizon C (t, q’) is not stable, the commutation is delayed 
up to the instant for which C (t, q7) becomes stable. 

A gradual transition of the ELS towards the RML may also be used by 
introducing a “contraction factor” in Ĉ (t q7). This corresponds to a filter defined 
by (Z + acıq”) with: 0 < æ <1, instead of (1+ cq”). This forces the polynomial 
roots into the unit circle. It is possible to use a variable contraction factor that 


asymptotically tends toward 1. This type of variation can be obtained using the 
formula 


a(t) =apa(t—1)+1-a (6.1.19) 


which corresponds to a first-order discrete stable filter with a unit static gain 
excited by a unit step (the final value is equal to 1). A possible choice for a is 


0.5 < ay = a0) < 0.99 


The recursive maximum likelihood method is used to improve, if necessary, the 
results of the extended least squares method. However, if the above mentioned 
precautions are not taken into account, the algorithm may diverge. 


6.1.4 Output Error with Extended Prediction Model (OQEEPM) 


Originally, this is an extension of the output error method (see further on in Section 
6.3). This method can be interpreted as a variant of the ELS. It offers asymptotic 
performances similar to the ELS, but with improved transient estimation (faster 
bias rejection). This method will be presented by means of an example. The “plant 
+ disturbance” model is given by Equation 6.1.3. 

The a priori adjustable predictor of the ELS (defined by Equation 6.1.7) can be 
rewritten in the form (adding and subtracting the term +â; (1) (4) ) 
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HP (C41) = (ND) +b (Qu) +4, Oe) + 4 OHO (6.1.20) 


and, by regrouping differently the terms of Equation 6.1.20, the structure of the a 
priori adjustable predictor used in the OEEPM is obtained: 


P+D =-G (NH) +H, Qu) +h De) = IOT 6D (6.1.21) 
where 


hy (0) =ê- (0) (6.1.22) 


60)" = 4040.40 ; dO" E Oue] 61.23) 
The a posteriori adjustable predictor is given by 

S+) =4(t +)! A(t) (6.1.24) 
and the prediction errors are given by 


E° (t+1)= yt+)-p° +h 


(6.1.25) 
elt+1)= p(t +1) -— pete) 


The parameter adaptation algorithm is the one given by Equations 5.5.1, 5.5.2 and 
5.5.3 with ôA) and ®(t) = g(t) as in Equation 6.1.23. In the general case: 


50)" =a 0)..4,, 0b O-n, OAOA O 
DAT =F $@...—H(t—n4 +D,ult-d)..ult-d -np +1), €()..e(t—nc +1] 


As for the ELS, «¢) asymptotically tends towards a white noise, thereby 
guaranteeing an unbiased estimation of the parameters of A(g~) and B(q^) (if the 
input is sufficiently rich). The convergence is subject to the same sufficient 
condition as in the ELS, i.e. the transfer function given by Equation 6.1.12 must be 
strictly positive real. 

Note that the values of the coefficients of C(q~/) are obtained from the relation: 


Ci =h; +a; (6.1.26) 


The difference with the ELS lies essentially within the components of vector 
Ø(t) in which the measurements (4) directly affected by the disturbance are 
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replaced by (A, which only indirectly depends upon the disturbance. This 


explains why a better estimation is obtained with this method than with the ELS 
method over short horizons. 


6.1.5 Generalized Least Squares (GLS) 


The aim of this method is to obtain a “white” prediction error for a “plant + 
disturbance” model having the form (structure S4): 


ADIO = B u + — el) (6.1.27) 
cq) 


(the term C(q~/)e(t) of the ARMAX model has been replaced by [//C(q~)]e(d)). 
This method will be illustrated by means of an example. The “plant + disturbance” 
model is given by: 


vE D= -ay + u(y + ED (6.1.28) 
l+c\q_ 
Let us define 
a(t+l)=(lt+ aq" )y(t+)) byu(t) = 9 (6.1.29) 
l+cq_ 
The relation 
(+c a(t +1) = e(t +1) (6.1.30) 


is then obtained (a(t) is a AR process — see Section 4.1.2). 
Assuming that the parameters are known, a predictor can be constructed 
ensuring a white prediction error 
p(t +1) =-a, y(t) + bult) -calt) (6.1.31) 
Indeed 


+1 t 
ar), ld 
I+cq_ I+cq_ 


y(t +1) — H(t +) = — = e(t +1) (6.1.32) 


If the parameters are not known, an adjustable predictor is built by replacing the 
known parameters in Equation 6.1.31 by their estimations. The a priori adjustable 
predictor will be given by 
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S41) = -å (Dy (1) +É Ou(t) -ê Na) = A)" 6) (6.1.33) 
in which 
AAT = li, (1),b,(0), ol > g(t)’ EOU- (6.1.34) 


The quantity a(é) will be estimated using Equation 6.1.29, in which the unknown 
parameter values are replaced by their estimations: 


a(t) = Alt, q yA -q Bg u(t) 


. É 7 (6.1.35) 
=(1+aqO0q YA -b Out -1) 
The a priori prediction error is defined as 
E° (t+1)=y(t+1)-9°(t+1) (6.1.36) 


Since the adjustable predictor equation given in Equation 6.1.33 has the 
formulation permitting the use of the least squares algorithm, as in the case of the 
ELS, the parameter adaptation algorithm is given by Equations 5.5.1, 5.5.2 and 
5.5.3. In this case M(A) is defined by Equation 6.1.34 and ¢%(t+/) by Equation 
6.1.36. In the general case 


Ho =a., (0.40.5, OAO- O 
a(t)’ =F y@)...- yt-n4+),ult-d)..ult-d-ng+1)-alt)...— alt -nc +1)] 


In the presence of a random disturbance corresponding to the S4 structure, and 
with an asymptotically decreasing adaptation gain, e(t) asymptotically tends 
towards white noise, thereby allowing an unbiased estimation of the model 
parameters. 

The convergence of the algorithm is nevertheless linked to a sufficient (but not 
necessary) condition 


ce) -2 ; 2>, 2 max⁄,(t) (6.1.37) 


is a strictly positive real transfer function. 
This method is used in particular if the disturbance has a narrow band 
frequency spectrum (for example a periodic disturbance close to a sinusoid). 


Indeed, this kind of disturbance can be fairly modeled by [1/C(q~)]e(t) with a few 
parameters whereas the modeling of this kind of disturbances by C(q helt) 


requires a high order for C(q7'). 
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6.2 Validation of the Models Identified with Type I Methods 


This section is concerned with the validation of models identified using methods 
based on the “whitening” of the prediction error. These methods are 


Recursive Least Squares (RLS) 

Extended Least Squares (ELS) 

Recursive Maximum Likelihood (RML) 

Output Error with Extended Prediction Model (QEEPM) 
Generalized Least Squares (GLS) 


The principle of the validation method is the following: 


e Ifthe “plant + disturbance” structure chosen is correct, i.e. representative of 
reality 

e If the degrees of the polynomials A(q~/), B(q-!), C(q-!) and the value of d 
(delay) have been correctly chosen 


then the prediction error «(¢) asymptotically tends towards white noise, that implies 


lim E{e(t)e(t —i)} = 0 i =1,2,3...;-1,-2,-3... 
t>00 


The validation method implements this principle. It is made up of several steps: 


1. Creation of an I/O file for the identified model (using the same input 
sequence as for the system) 

2. Creation of a prediction error file for the identified model (minimum 100 
samples) 

3. “Whiteness“ (uncorellation) test on the prediction errors sequence (also 
known as residual prediction errors) 


Whiteness test 
Let {&(f)} be the centered sequence of the residual prediction errors (centered: the 
mean value is subtracted from the measured values). 

One computes 


N 


R(O)= a > E€ (t) ; RN(0) (0) 1 (6.2.1) 
RO=} 5 i) ; RN(i) = 2. = (=1,2,3..0 6.2.2 
(i) = 7 é(t)e(t—-i) ; (i) = RO) ; i=l23 ia (6.2.2) 


t=1 


where 
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imax = Max(n 4,Np +d) 
and the RM(i) are estimations of the (normalized) autocorrelations. 

If the residual prediction error sequence is perfectly white (theoretical situation) 
and the number of samples is very large (N — ©) one gets RN(0) = 1 ; RM) = 0 
i= PL. 

In real situations, however, this is never the case (i.e. RN(i) + 0 ; i= 1) since on 
one hand e(t) contains residual structural errors (order errors, non-linear effects, 
non-gaussian noises) and, on the other hand, the number of samples is generally 
relatively small (several hundreds). Also, it should be kept in mind that one always 
seeks to identify good simple models (with few parameters). 

One considers as a practical validation criterion (extensively tested on 
applications) 


RN(O)=1 ; Ruo < 2 ; i21 (6.2.3) 


wN 
where N is the number of samples. 

This test has been defined taking into account the fact that, for white noise, the 
sequence RN(i) (i+ 0) has an asymptotically gaussian (normal) distribution with 
zero mean and standard deviation: o = IAIN ‘ 

The confidence interval considered in Equation 6.2.3 corresponds to a 3% level 
of significance of the hypothesis test for a gaussian distribution. 

Indeed, if RM(i) obeys the gaussian distribution (0, IAIN ), there is only a 
probability of 1.5 % that RN(i) is larger than 2. / 7AIN , or that RM(i) is smaller than 
~2.17A[N . Therefore, if a computed value RN(i) falls outside the range of the 
confidence interval, the hypothesis on the basis of which &(f) and «&(t-i) are 
independent should be rejected, i.e. {e(t)} is not a white noise sequence. 

Sharper confidence intervals can be defined. Table 6.1 gives the values of the 
validation criterion for various N and a 3% test level of significance as well as for 5 
and 7% level of significance. 


Table 6.1. Confidence intervals for independence (whiteness) tests 


N=51 
Level of significance N=128 | N=256 ea 
2 
3% 
(validation criterion) 217A[N | 0.192 | 0.136 | 0.096 
0.087 


0 

iso | oaz |0122 
0 

L808 0.113 


? For gaussian data, uncorrelation implies independence. In this case RNG) = 0, i = 1 implies 
independence between «(f), &(t-1) i.e. the sequence of residuals {e(t)} is a gaussian white noise. 
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The following remarks are imperative: 


An acceptable identified model has in general 


1.8 2.17 


P= hzl 


max 


|RN (|< 


Taking into account the relative weight of various non-gaussian and 
modeling errors (which increase with the number of samples), the 
validation criterion may be slightly tightened for small N and slightly 
relaxed for large N. Therefore, for simplicity's sake, one can consider for 
the validation criterion the following practical value 


|RN(i)| < 0.15 i=l,...,i 


max 


A too good validation criterion indicates that model simplifications may be 
possible. 

If several identified models have the same complexity (number of 
parameters), one selects the model given by the methods which lead to the 
smallest |RN(i)| and R(0). 


Note also that a complete model validation implies, after the validation done 
with the input/output sequence used for identification, a validation using a new 
plant input/output sequence. 

There is another important point to consider: if the level of the residual 
prediction errors is very low compared to the output level (lets us say more than 60 
dB) the whiteness test loses its significance. This occurs because on one hand the 
noise level is so low that the bias on the RLS is negligible and, on the other hand, 
because the residual noise may not be gaussian to a large extent (for example, 
noise caused by the propagation of round-off errors). This situation may occur 
when identifying simulated I/O data generated without disturbances. 


6.3 Identification Methods Based on the Uncorrelation of the 
Observation Vector and the Prediction Error (Type ID 


The following recursive identification methods fall into this category: 


Instrumental Variable with Auxiliary Model (IVAM) 
Output Error with Fixed Compensator (OEFC) 

Output Error with Filtered Observations (OEFO) 

Output Error with Adaptive Filtered Observations (QEAFO) 
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6.3.1 Instrumental Variable with Auxiliary Model 

The general idea behind the instrumental variable methods consists in creating a 
new observation vector which is highly correlated with the uncontaminated 
variables (and therefore representative), but uncorrelated with the noise disturbance 
in order to obtain E{ A(t) at+1)} = 0. 


The “plant + disturbance” model considered in this case is that of structure S2 
(see Section 5.5): 


AYE) =“ Bq u(t) + w(t +1) (6.3.1) 
in which 
w(t +1) = A(q7')w(t) (6.3.2) 


and corresponding to the diagram given in Figure 6.2. 


Figure 6.2. The “plant + disturbance” structure (type S2) 
w(t) is any disturbance, independent from u(t), with zero mean value and a finite 


variance. 
The final objective is to obtain unbiased estimations of the coefficients of 


A(q"') and B(q-“) without taking into consideration a model for the disturbance. 


Thus, one builds an instrumental vector uncorrelated with the prediction error 
provided by the least squares predictor. 

Let consider the following example, where the “plant + disturbance” is 
described by: 


y(t +1) = —a, y(t) + bu(t) + w(t +1) (6.3.3) 
where 

w(t+1l)=(1+a,q7')w(t +1) (6.3.4) 
Let consider the recursive least squares adjustable predictor 

PED = -å Dy +b Ou) = ÔO OO) (6.3.5) 


in which 
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TOAGA O 3 oO" OTO) (6.3.6) 
and respectively 
Ht+1) = O41)" AA (6.3.7) 


the prediction errors being defined by: 


e (t+) = yp(t+)—-3° +) (6.3.8) 
é(t+1) = y(t 1) -P+ (6.3.9) 


Let us define an auxiliary prediction model that provides the instrumental variable: 


Vy t) =-å Oy jy (t-1) +b, Out -1) (6.3.10) 


This prediction model differs from the one given by Equations 6.3.5 or 6.3.7 as the 
predicted output depends on the previous predictions and not on the previous 
outputs (y(t-1) has been replaced by y,,(t-/)). These new variables will be less 


affected by disturbances, which will have an effect only through the PAA. If a 
decreasing adaptation gain is used, ypt) will asymptotically depend only on u(t-1), 


that is not the case for » (£) or y(t) respectively given by Equations 6.3.5 and 


6.3.7 (as (f) is a noisy signal). 
The new observations vector is defined by 


DO =b7 O" =F yr Ouo] (6.3.11) 
One observes that (4), y(t-/),..., which are used in recursive least squares, have 
been replaced by yr), yjAt-L)... 
In the general case, the observations vector has the structure: 


DA =pr O =E yy OW-yy(t-D,...u¢—d@),u(t—d -D),..] (6.3.12) 


and the instrumental variable y,,,is generated by the auxiliary model 
Atq yw (O =q" BE, q u(t) (6.3.13) 
where 


At, gh =1+4,()q"' +... (6.3.14) 
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Bit,q') =b O! +b Oq? +... (6.3.15) 


The parameter adaptation algorithm is given by Equations 5.5.1, 5.5.2 and 
5.5.3, in which ®(f) is now given by Equation 6.3.12. This method uses the same 
adjustable predictor of RLS for generating the prediction error but the observation 
vector is different. For yyt) to be representative of y(t), an estimation of a, and b, 
is required. This is why this method must be initialized by the recursive least 
squares. In general, an initialization horizon is chosen equal to five (up to eight) 
times the number of parameters to be identified. If the initialization horizon is not 
enough long, divergence of the algorithm may occur. 


6.3.2 Output Error with Fixed Compensator 


The “plant + disturbance” model is the one given by Equations 6.3.1 and 6.3.2 and, 
for the first order example, by Equations 6.3.3 and 6.3.4 respectively. 

The idea behind this method is the observation that, in the absence of 
disturbances, the output predicted by the RLS predictor ŷ (t+7) tends towards 
y(t+/). In these conditions one can consider replacing y(t) by Ŷ (Ð (the a posteriori 
prediction) in the predictor equation. 

Indeed, consider, by means of an example, the RLS adjustable predictor for the 
“plant + disturbance” model of Equation 6.3.3 


$°(t +1) = -â (1) y(t) +B, (u(t) (6.3.16) 


and replace in Equation 6.3.16 y(£) by 9 (À (“output error” type predictor). Then, 


we get 

S 0+1) = -â (NFO +b Qu) = AN KO (6.3.17) 
in which 

TOON E O ONO) (6.3.18) 
where 

E+) = 0041" GO) => SO =O! Ht- (6.3.19) 


represents the new a posteriori prediction. 

The difference between the RLS and the Output Error is illustrated in Figure 
6.3. 

The usefulness of this modification is clearly seen in the presence of 
disturbances. If p is used instead of y(t) in the predictor equation and in the 
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observations vector, one can see that, with an asymptotically decreasing adaptation 
gain, y(t) will only depend on u(t) (which is not the case for the RLS predictor) 


and this will asymptotically lead to E{¢(t) &(t+1)} = 0. As a consequence a plant 
model with unbiased parameter estimates will be obtained. 

In the general case, the observation vector used both in the predictor and in the 
parameter adaptation algorithm is of the form 


DA =A =-SO—H(t-D,... Ht—n, +)),u(t—d),....u(t-d—n, +1)] (6.3.20) 


DISTURBANCES 


Recursive Least Squares (RLS) 
j DISTURBANCE 
u(t) y(t) 


Output Error (OE) 


Figure 6.3. Comparison between the recursive least squares and the output error prediction 
structures 


The prediction errors are defined from Equations 6.3.3, 6.3.17 and 6.3.19: 


E° (t+1)= y(t+1)- 9° (t+) 
elt+1)=y(t+1)-ŷ(t+1) 


(6.3.21) 


and the adaptation algorithm given by Equations 5.5.1 through 5.1.3 is used. 
One can also define, in the general case, an adaptation error (v) obtained by 
filtering the prediction error: 
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v(t +1) = D(q elt +1) 


i Í (6.3.22) 
D(g )=l+djg +..+ dyg 


v°(t+l)= e°(t+l+ > de¢+1-i) (6.3.23) 
i=l 


In this case, we replace in the adaptation algorithm of Equations 5.5.1 through 
5.5.3, e(t+1) and &t+/) respectively by Y(t+/) and t+/). 

This is a method that assures therefore an unbiased identification of the 
coefficients of A(q/) and B(q~/), without using a model for the disturbance to be 
estimated, and without requiring an initialization by another method. 

This method is subject to a sufficient convergence condition (both in the case 
without and the case with disturbances): 


Diz") A, 
Az") 2 


; 2>A, 2max/,(t) (6.3.24) 


should be a strictly positive real transfer function. This is why the filter Dq! ) on 
the prediction error has been introduced. 

For nį < 2 (n4 = deg A(q”)), the compensator D(q7) is not necessary (since 
1/A(q') - A,/2 is strictly positive real almost everywhere A(q-/) is asymptotically 
stable). For n, > 2 and a decreasing adaptation gain, the compensator is generally 
unnecessary (it is proved that the prediction error remains bounded). If the 
compensator is introduced, one takes ng < ny - 1 or n4 (ng = degree D(q-')). 

Since the condition on the transfer function of Equation 6.3.24 is only 
sufficient, D(q/) = Z (no compensator) is always used to start, and a compensator 
is introduced only if the prediction error diverges. 

It is also possible to estimate simultaneously model parameters and those of the 


filter on the prediction error (output error with adjustable compensator). For more 
details see Landau (2001b), Landau et al. (1997). 


6.3.3 Output Error with (Adaptive) Filtered Observations 


It is an extension of the basic output error method in which the filtering of the 
prediction error is replaced by the filtering of the observation vector (in order to 
satisfy the convergence conditions). 

The equations for the adjustable predictor and the prediction errors are the same 
as for the output error with fixed compensator (Equations 6.3.16 to 6.3.19 and 
6.3.21). 

One uses the prediction error as adaptation error (it is not filtered). However, 
this algorithm uses a filtered version of the observation vector. 
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For the output error with filtered observations one defines a filter with constant 
parameters: 


Lq) = Aq") (6.3.25) 


where A(q')is an estimation of the polynomial A(q') obtained by another 


estimation algorithm (for example: recursive least squares or output error without 
filtering of the prediction error) and one defines the vector of filtered observations 


Ht): 


O() = 4,() =H) (6.3.26) 
Alq ) 


where ((f) is given by Equation 6.3.20. 
One can uses instead of the filter of Equation 6.3.25 a filter with time varying 
parameters: 


L(q"',t)= Aq!) (6.3.27) 


where A(t,q"') is an estimation of the polynomial A(q™!) at instant ¢ (provided by 
the parameter adaptation algorithm) and the vector of filtered observations is 
defined by Equation 6.3.26 where 4(q~') is replaced by A(t,q~!). One obtains the 


output error with adaptive filtered observations. 
As in the case of the recursive maximum likelihood algorithm, a stability test 


on A(t,q7!) should be done at each sampling. 


The initialization of the algorithm can be done by the non-filtered output error 
algorithm (with no compensator) or the recursive least squares (in order to get a 


first estimation of 4(q~')), but this is not mandatory since the algorithm can start 
with 4(0,q7!) =1). 

The sufficient condition for the convergence of the algorithm is expressed for a 
fixed value of the filter L(t,q7!) = L(q~',6) = A(q"',6): 


A(z, ô) oA 


Heys 
Sr a 


; 2>A, 2 max A, (t) (6.3.28) 
t 


should be a strictly positive real discrete time transfer function. In particular, this 


condition will always be satisfied around the correct value ĝô=0. 
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6.4 Validation of the models identified with Type II Methods 


This section is concerned with the validation of models identified using the 
identification methods based on the uncorrelation between the observations and the 
prediction errors. 

These methods are: 


Instrumental Variable with Auxiliary Model (IVAM) 
Output Error with Fixed Compensator (OEFC) 

Output Error with Filtered Observations (OEFO) 

Output Error with Adaptive Filtered Observations (OEAFO) 


The principle of the validation method is as follows: 


e If the disturbance is independent of the input (F {w(A) u(y} = 0) 

e If the “model + disturbance” structure chosen is correct, i.e., representative 
of the reality 

e If an appropriate identification method has been used for the chosen 
structure 

e If the degrees of the polynomials A(q~/), B(q-/) and the value of d (delay) 
have been correctly chosen 


then the predicted outputs generated by a predictor model of “output error” type 


A(q!) A= qt Ê (gq!) ult) 


are asymptotically uncorrelated with respect to the output prediction error, that 
implies 


N 
Eeo- ED eO- =0 > i=1,2,3,.. 


t=l 


The validation method implements this principle. It is made up of several steps: 


e Creation of an I/O file for the identified model (using the same input 
sequence as for the system) 

e Creation of files for the sequences {v(A}; {9 ()}; {e(H} (system output, 
model output, residual output prediction error). These files must contain at 
least 100 samples 

e Uncorrelation test between the residual output prediction error sequence 
and the delayed prediction model output sequences 


Uncorrelation test 
Let {(t)} and { »()} be the centered output sequences of the plant and of the 


identified model respectively. 
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Let {4} be the centered sequence of the residual output (prediction) errors 
(centered = measured values - mean values). 
One computes 


N 
RO=—YAOHt-) 5 i= ON 2st (6.4.1) 


t=1 
RG) 


broke] 


t=1 


2012.8 (6.4.2) 


max 


where 


imax = MaAX(n 4, Ng +d) 


and the RN(i) are estimations of the (normalized) cross-correlations. Note that 
RN(O) # 1. 

If the uncorrelation is perfect between at) and j (ti), i = J (theoretical 
situation) thus 


RN()) = RN (i) =0 ; i=1,2,. imax 


In practice this is never the case, either because the duration of the identification 
was not long enough to approach the asymptotic character, or because the 
identification of good simple models is desired (with few parameters, i.e. under 
estimation of the orders of A(q-/) and B(q~/)), which results in structural errors 
which are correlated with the input u(t). 

In practice it is desired that the values of |RM()|, i = 1,..., imax be as small as 
possible, but the difficulty lies in defining a reference (validation criterion). 

The validation criterion for type II identification methods based on an 
uncorrelation test will be defined similarly to that for type I identification methods 
which also use an uncorrelation test, but on different sequences of variables (see 
Section 6.2). In this case one therefore considers as a practical validation criterion 


RNE > i=1,2. i 
RN 


VN 


where N is the number of samples. Table 6.1 can be used for finding the numerical 
value of the validation criterion for various N and levels of signification of the test. 


max 
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All the comments made in Section 6.2 upon the significance of the values of the 
validation criterion remain valid. In particular the basic practical numerical value 
for the validation criterion which is 


|RN(@|<0.15 ; i=1,2,. 


-.» Lmax 


is worth remembering. 

One can say that the uncorrelation test allows one to compare the results 
provided by all identification methods since it only requires the parameters of the 
plant model (B(q"),A(q")). Therefore, it is useful to perform this validation test 
even for models identified with type I identification methods in order to compare 
them with estimated models obtained with type II identification methods. 

In short, one only takes the estimated plant model (B(q"),A(q")) obtained with 
type I identification methods (the noise model is not considered) and one performs 
the uncorrelation test. The best model is that which will give the lowest cross- 
correlation terms?. 


6.5 Estimation of the Model Complexity‘ 


6.5.1 An Example 


In order to understand the principle of the model complexity estimation, let us 
consider a first-order discrete time model. It will be assumed that there is no noise. 
Assume that the plant model is described by 


y(t) =- a, y(t-1) +b, u(t-1) (6.5.1) 


and that the data are not corrupted by noise. The order of this model is 
n=max(n,,Ng +d)=1 

Question: Does there exist a test allowing one to verify if the hypothesis upon 
the order of the model is correct? 

Construct the following matrix: 


e On the first row one writes y(t) as well as the variables represented in the 
right hand term of Equation6.5.1 

e The other rows are formed by the delayed variables occurring in Equation 
6.5.1. 


3 However, in comparing the models obtained by type I identification methods, priority will be given to 
the whiteness test. 
4 Can be omitted for a first reading. 
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y(t) A —y(t-1 ult —1 

y(t-1) | -y(t-2) ult-2) =F RO] 

yt-2) | -y(t-3) u(r-3) (6.5.2) 
ue R(1)=R(a) 


The resulting matrix can be split into two parts: the first column denoted Y(t), is 
a vector containing the current and previous outputs ; the remaining rows define a 
matrix denoted by R(1). 

If the structure of Equation 6.5.1 is true (which means that it can represent the 
relationship between u and y), one can replace the components of the first column 
of Equation 6.5.2 by their expression given by Equation 6.5.1. One obtains by 
evaluating the determinant of the matrix given in Equation 6.5.2: 


aylt 1)+bult-1) |: -y(t-1) u(t-1) 
rank{Y ®©) R()] =ran aylt 2) + bult 2) : y(t u(t 2) =2 (< 3) (6.5.3) 
ayy(t—3)+bu(t-3) : —y(t-3) u(t-3) 


N 
na 


since the first column is a linear combination of the two other columns. Effectively 
Y(t) = R()O with 67 = [a,,5,] and the rank of the matrix is 2 (instead of 3). 

It results that the rank test on the matrix of Equation 6.5.2 (size of the largest 
non-null determinant) allows one to conclude upon the validity of the structure of 
the model considered for representing the plant. 

Let assume that the plant model is second-order and that the data are not 
corrupted by noise. It can be described by the following equation: 


y(t) = Sarl ~i)+ 2 bul =i) (6.5.4) 


rank y(t 1) y(t 2) u(t—2))=3 = full rank 
y(t-2) | -y(t-3) u(e-3) (6.5.5) 


a a R() 


The determinant of the matrix of Equation 6.5.5 is not null since Y(t) cannot be 
expressed as a linear combination of columns 2 and 3. 
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However if one also uses the measurements from the instant ¢t-2, one can 
construct the following matrix: 


y(t) : -y(t-1) -ye-2) ufe-1) u(e-2) 

yt-1) : -ylt-2) —y(t-3) u(t-2) u(t-3) 

y(t-2) : -y(t-3) -y¢-4) ult-3) ufe-4)|=PQ RO] 

y(t-3) : -—y(e-4) -y(t—-5) u(t—4) u(t—5) (6.5.6) 
y(t—4) : —y(t-5) -y(t-6) u(t-5) u(t-6) 

T T 

Y(t) R(2)= Râ) 


The rank of this matrix is strictly less than 5 (in fact it is equal to 4), since Y(t) 
is a linear combination of columns 2, 3, 4 and 5. 

The objective of model order estimation will be to search for the number of 
columns that has to be added in order to be able to express Y(t) as a linear 
combination of the other columns (one adds the same number of delayed columns 
of y and u) . The algorithm will stop when the matrix of the form given in 
Equation 6.5.6 is no more of full rank. In this way n = max (n 4, ng + d). 


6.5.2 The Ideal Case (No Noise) 


In the ideal case, which means in the absence of noise, we are interested to 
estimate the order (complexity) of a model of the form 


y(t) -Y aye -D+ but- (6.5.7) 
i=l i=l 


by the rank test. To do this, one constructs the matrix 


-y(t -1) az -y(t ~f) u(t-1) ult -n) 
Ras — y(t-2) oe ~y(t-A#-1) u(t—2) «+ u(t-A-1) 
-y(t-N) = =y(t-A-N 41) u(t-N) --u(t-a-N+1)| (6.5.8) 
gel? 
=| o(t—2)" 
gt—N)" 


where 


pt- =[-y¢-J),.-y(t-A-j +),u(t—-/),..ut-A-j+D];j=h..,N (6.5.9) 
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and the vector 

Y(t)’ =[y@, y(t -1),.-5 X(t - N +1)] (6.5.10) 
and one tests the rank of the matrix 

FeO : RA) (6.5.11) 


for increasing values of the estimated order ñ. 


Remark: the number of data N should be larger than 2nmaxt1 (where nmax is 
the supposed maximum value of the model order). 
One has the following result: 


© Ifû<n, [Y : RA) isa full rank matrix (of rank 2â+1). 
e If n=n, [Y (t) : R(a)| is not a full rank matrix (rank 2n instead of 
2n+1). 


The value used to test the rank can be the determinant, the singular values of the 
matrix, efc.. 


6.5.3 The Noisy Case 


In the presence of noise, Equation 6.5.7 becomes 


rO- any bul +0) (6.5.12) 


i=l i=l 


where w(t) represents the noise effect. 
Unfortunately, the method presented earlier does not work when noise is 
present since the matrix [Y (t) : R(a)| never becomes singular. 


White noise 

It is important to remark that the rank test is equivalent to the search of a parameter 
vector @ that minimizes the following criterion for an estimated value of the model 
order denoted by ñ 5: 


Jis(i)= minre- R(A)O, i (6.5.13) 
ô N 


2 
2 |x| =x" x. 
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where @ expresses the linear dependence of Y(t) with respect to the columns 
of R(n) . However this criterion is the least squares criterion of Equation 5.2.40. 

Taking in account Equations 6.5.8, 6.5.9 and 6.5.10, Equation 6.5.13 can be 
expressed as 


Jis(i)= min YG noe -v] 


i=t-N+1 


where 
ar fa n & x 
03 e E E E al 


Therefore, for the case where the noise in Equation 6.5.12 is white, the use of 
the least squares algorithm (the least squares estimation algorithm is unbiased in 
this case) allows one to estimate the order of the model by evaluating the value of 
the criterion for increasing estimated ordersń. If n>n the criterion becomes 
practically null, or takes a constant value in the presence of white noise in Equation 
6.5.12 (this is illustrated in Figure 6.4) 


Non-white noise 
However, the procedure for order estimation will not work when the noise in 
Equation 6.5.12 is not white since the difference J,.(n)—J,5(@+1) does not 
really goes towards 0 when n>n (i.e. the procedure tends to overestimate the 
order of the model). 

To overcome this problem one should use an algorithm allowing one to obtain 
an unbiased estimation of 0;. To achieve this one can use the technique of 
“instrumental variables” (used also in Section 6.3.1). 


Jis (ñ) 


White noise 


Non white noise 


Figure 6.4. Least squares criterion evolution as a function of 71 
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In this approach one replaces the measurements by the instrumental variables that 
are correlated with the “good” measures but less correlated with the noise. The 
number of instrumental variables to be used (2L) should be larger than twice the 
order of the model to be estimated. One can use the delayed inputs as instrumental 
variables, since u(t-L) is correlated with y(t) for L > ñ ( see Equation 6.5.12), but, 
on the other hand, u(t) is not correlated with the noise. 

In this case one replaces R(ñ) and Y(t) by Ry (â) and Y,,(t)where 


Ry â)=Mp RÂ) ; YyO=MyYO (6.5.14) 
M jy is the matrix of instrumental variables and it is constructed from the matrix 


ZT (â)= [ør t), pr (+-2),.-..b 7 (tN) (6.5.15) 


where 
pi (t-j) = [-u(t-L-j),...,u(t-L-n-j +1 ),u(t-j),.. u(t-ñ-j +1 )] (6.5.16) 


One searches first for a matrix 


o|] 


such that (triangularization of the matrix Z (â)) 
Q,Z(â)= Z, (ñ) 


where Z, (â) is a triangular matrix and 


The matrix of instrumental variables M y is given by® 
My =(27)'2? 


The test quantity becomes in this case 


6 The construction of the instrumental variables in this case is related to the orthogonal projection of the 


measurements on the space defined by Z (â) : 
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Jy (a)= min— [iy (t)—R,,(A)o | (6.5.17) 


A theoretical study shows that this quantity goes towards 0 as the estimated order 
approaches the true one (Duong and Landau 1996)’. As a consequence, a 
significant slope change will appears on the curve Jj, (â), allowing, in general, a 


clear estimation of the order. 
6.5.4 Criterion for Complexity Estimation 


One of the objectives of system identification is to estimate models of reduced 
order (parsimony principle). It is therefore reasonable to add to the criterion of 
Equation 6.5.17 a term that penalizes the model complexity. Such a term can be of 
the form 


j- 2n log(N) 


Sâ, N 
N 


(6.5.18) 


but other choices are possible (Duong and Landau 1996; Söderström and Stoica 
1989). 
One defines the criterion for model order estimation as 


CI y (a) =J pâ) +S, N) (6.5.19) 


and therefore ñ will be given by the value that minimizes the criterion of Equation 
6.5.19: 


h=n > Cliy(a)=min (6.5.20) 


The complexity estimation obtained in this way is consistent, which means that one 
finds the exact order as the number of data tends toward infinity (N — œ). 

A typical curve for the evolution of the criterion 6.5.18 as a function of nis 
given in Figure 6.5. 

Once the order ñ is estimated, one can apply a similar procedure for estimating 


n-d,f4, igt+d from which n,,f,, and d are obtained. 
The functions estorderls.sci, estorderiv.sci (Scilab) and _ estorderls.m, 


estorderiv.m (MATLAB*) implement the above described techniques for model 
order estimation’. 


7 Tt is shown in (Duong, Landau 1996) that J Iv (ñ ) has a well defined statistical distribution allowing 


to define an “over estimation risk” for the estimation of the model order ñ . 
8 Available on the book website. 
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Other aspects related to the estimation of n4, ng, and d will be presented in 
Chapter 7, Section 7.3. 


minimum 


Figure 6.5. Evolution of the criterion for the estimation of the model order 


6.6 Concluding Remarks 


In this chapter recursive identification methods have been presented. They have 
been classified in two categories: 

The first category includes the identification methods based on the whitening of 
the prediction error in order to get unbiased parameter estimates. The following 
identification methods belong to this category: 


Recursive Least Squares (RLS) 

Extended Least Squares (ELS) 

Recursive Maximum Likelihood (RML) 

Output Error with Extended Prediction Model (O.E.E.P.M) 
Generalized Least Squares (GLS) 


The validation of the models identified using these methods consists in testing if 
the residual prediction error sequence is approaching the characteristics of a white 
noise sequence. This is done by carrying out a whiteness test on the sequence of 
residuals. An acceptable identified model should verify the condition 


Ruci 2 ; i=1,2,...,max(n4,ng +d) 


VN 


where 
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ir i< 
RN(i) = FeDe =i) [Ree o 


il t=1 


and N is the number of samples. 

The second category includes the identification methods based on the 
uncorrelation between the prediction error and the observations in order to get 
unbiased parameter estimates. The following identification methods belong to this 
category: 


e Instrumental Variable with Auxiliary Model (IVAM) 

e Output Error with Fixed Compensator (OEFC) 

e = Output Error with Filtered Observations (OEFO) 

e Output Error with Adaptive Filtered Observations (OEAFO) 

The validation of models identified using these methods consist in testing if the 
residual prediction error sequence and the predicted outputs (generated by the 


model A(q~/) 9 (t) =q! B (q) u(2)) are uncorrelated. This is done by carrying out 
an uncorrelation test. An acceptable identified model should verify the condition: 


RN < 2 ; i=1,2,...,max(n4,n, +d) 


VN 


where 


IS nw JH ia Pi So 1? 
RNO = YFOHE-D/q FL OFr O 
t=l 


t=1 t=l 


and N is the number of samples. 

Taking into account the relative weight of various non-gaussian and modeling 
errors (which increases with the number of samples), the validation criterion can be 
slightly tightened for small N and slightly relaxed for large N. Therefore, for 
simplicity's sake, one can consider as a basic practical numerical value for the 
validation criterion (for both tests) the value 


|IRN(i|< 0.15 ; i=1,2,...,max(n4,ng +d) 


Before doing a parameter estimation, it is obviously necessary either to estimate 
the order of the model from the data, or to choose a model order from the available 
a priori information. The techniques of order estimation from input/output data 
have been presented in Section 6.5 

The problem of order estimation can be converted in a parameter identification 
problem whose objective is to minimize a criterion with two terms. One of the 
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terms of the criterion corresponds to the variance of the prediction error, while the 
other term is a penalty terms which increases with the order of the model. 
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Practical Aspects of System Identification 


This chapter reviews a variety of practical aspects concerning system 
identification. Several identification examples are presented, using both simulated 
data and real data from several plants (air heater, distillation column, DC motor, 
flexible transmission). 


7.1 Input/Output Data Acquisition 


7.1.1 Acquisition Protocol 


In Chapter 5, Section 5.3 it was shown that, in order to obtain a good identified 
model, the excitation signal (applied to the plant input) should contain a wide 
spectrum of frequencies. This signal will be superposed to the steady state control 
signal corresponding to the operating point around which we would like to identify 
the model of the plant. 

As a general rule, one uses as an excitation signal a PRBS (pseudo random 
binary sequence) with a low magnitude. The properties of the PRBS have been 
examined in Chapter 5, Section 5.3.2. 

We recall that, for correctly estimating the steady state gain of the dynamical 
model, it is necessary that at least the duration of one of the pulses of the PRBS be 
larger than the rising time of the plant to be identified. This leads to the following 
condition: 


PNT, 2 tp 


where 


e T,= sampling period 
e p= frequency divider 
e pT,=clock period of the PRBS generator (clock frequency = fyp) 
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e N= number of cells of the shift register 
e ty = rising time of the system 


The magnitude of the PRBS should not exceed, as a general rule, a few percent of 
the steady state control signal amplitude. 

Data acquisition is done either by dedicated data acquisition equipment or, very 
often, by using a computer equipped with a data acquisition board containing 
analog-to-digital and digital-to-analog converters. The board is emulated by the 
computer, which provides the PRBS and the input DC component corresponding to 
the operating point. 

A C™ program as well as a MATLAB" function (prbs.m) for the generation of 
the PRBS can be downloaded from the book website. 

Several options for connecting the data acquisition system to the plant are 
possible. 


Plant Operated in Open Loop 
This is the most typical case and the simplest one. It is illustrated in Figure 7.1. 


Physical 


system 


Measure 


Figure 7.1. Data acquisition for system identification - plant operated in open loop 


In this situation, the excitation signal superposed to the DC control signal 
corresponding to the operating point is directly applied to the process. To start the 
data acquisition protocol, the plant should be in a steady state operation regime 
(i.e. the PRBS is sent once the transient related to the application of the DC 
control signal is over). 


Plant Operated in Closed Loop 
In this situation two possibilities can be considered: 
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Figure 7.2. Data acquisition for identification — plant operated in closed loop with excitation 
signal added to the controller output 


1. Excitation superposed to the controller output 
The PRBS is added to the controller output and one performs the 
acquisition of the PRBS and of the effective input applied to the plant 
together with the corresponding plant output. The transfer between yọ and 
yı will be identified. 

2. Excitation on the reference 

The PRBS is added to the reference defining the operating point and one 
performs the acquisition of the PRBS, the input and the output of the plant. 
This is shown in Figure 7.3. 
If one would like to identify the plant model from data acquisition in closed loop 
operation, two options can be considered. 

In the first case one tries to ignore the presence of the controller. For this, it is 
important to use what is called a “soft” controller. In the case of a PID one should 
suppress the derivative action and use a low value of proportional gain. However 
the integral action is important for maintaining in the average the operating point. 

If an RST controller is used, the design based on an imprecise available model 
should be done such that the closed loop is slow but the presence of an integrator in 
the controller is important in order to maintain the operating point. The quality of 
the model obtained with this approach can vary considerably. 

In the second case, one uses dedicated methods for plant model identification 
in closed loop operation. These methods, which take into account the presence of 
the controller, are presented in Chapter 9. They provide, in general, excellent 
identified models. 
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Figure 7.3. Data acquisition for identification — plant operated in closed loop with excitation 
added to the reference 


7.1.2 Anti-Aliasing Filtering 


It was shown in Chapter 2, Section 2.2, that the conversion of signals having a 
frequency spectrum exceeding 0.5 fg will introduce distortions on the discretized 
signal in the useful band between 0 and 0.5 fy. 

In order to avoid this situation, it is necessary to insert between the plant output 
and the analog to digital converter a continuous time anti-aliasing filter (low pass 
filter) allowing to significantly attenuate the components of the signal beyond 0. 5f,. 

The violation of this rule can produce important errors in identification. Even if 
one may be able to get discrete time models that can be validated, they do not 
represent, in practice, the real behavior of the system (i.e. the continuous time 
behavior of the plant). 


7.1.3 Over Sampling 


Different situations encountered in practice lead to the use of a data acquisition 
frequency that is a multiple of the sampling frequency used in the control loop 
(over — sampling). For example: 


e In many digital control systems (DCS), the data acquisition frequency is 
significantly higher than the one used in the control loops. 

e In systems using a sampling period for the control loop that is higher than 
ls, it becomes difficult to implement a continuous time anti aliasing filter 
and it is necessary to use a digital filtering technique. 


In both cases, one should do data acquisition at a frequency which is a multiple of 
the sampling frequency used for control (or conversely: the sampling frequency of 
the control loop should be a sub-multiple of the data acquisition frequency): 
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ti = nf, 


where 


e f= data acquisition frequency 
e n=ratio of frequencies (integer) 
e f,=sampling frequency of the control loop 


The discrete time signal obtained at the frequency fa is passed through a digital 
anti-aliasing filter which will attenuate the signal components over 
0.5f, =0.5f, /n. On the resulting sequence we will take data every n samples 
(decimation). The implementation of a data acquisition using over-sampling is 
illustrated in Figure 7.4. 


Digital 
filter 


A/D converter under-sampling 
(acquisition frequency) (Ts =n.Ta) 


Figure 7.4. Implementation of the data acquisition using over-sampling 
Ifn is sufficiently large (n = 4), a moving average type filter 


— yt)+y(t-l+...4+ y¢-n+l1) 
n 


yp) 


will be enough. 

When using over-sampling for data acquisition, one should pay attention how 
the frequency divider (p) for the clock frequency of the PRBS is chosen. The 
frequency divider used for the PRBS should be a multiple of n, in order that the 
final sampling frequency f; is still an integer multiple of the clock frequency of the 
PRBS. 

The clock frequency of the PRBS is given by 


1 
FS pras =— fa 
P 


The final sampling frequency is given by 


1 P 
Js = =f = — f pres 
n n 


where (p/n) should be an integer. 
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7.2 Signal Conditioning 


7.2.1 Elimination of the DC Component 


The structures of the models used for identification correspond to dynamic models 
(that express output variations as a function of input variations around an operating 
point). 

It is therefore necessary, for a correct identification, to eliminate from the 
input-output data either the DC components (corresponding to the operating point) 
or the slow drift of the operating point during identification. 


Case 1. Elimination of stationary (or quasi-stationary) DC components. 
This is carried out in two stages: 


a. Computation of the mean value (MV) of the I/O files 
b. The mean value of the I/O files is subtracted from the I/O data and a new 
I/O file is created 


Case 2. Elimination of non-stationary DC components (drift) 
The I/O measurement files are replaced by variations of the I/O measurements 
filtered if necessary: 


y= y(t) -y(t-1) . wee u(t) —u(t—1) 
1+ fiq” 1+ fiq” 
with 
—0,5< fi <0 


but other types of filters may be used. 
7.2.2 Identification of a Plant Containing a Pure Integrator 


A plant incorporating a pure integrator may be identified. However, if the existence 
of this integrator is known a priori, this a priori information can be used to reduce 
the complexity of the model to be identified and to improve the precision of the 
identification. Two methods can be used: 


1. The input is replaced by its integral, the output remaining the same: 


y=) ; vo- 
l-q 


2. The output is replaced by its variations, the input remaining the same: 
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VO=rvO-ve-Y ; w(t) = u(t) 
yd and u(t) may also be filtered if necessary. 
7.2.3 Identification of a Plant Containing a Pure Differentiator 


If the presence of a differentiator is known, this a priori information can be used. In 
this case, the input is replaced by its variations, the output remaining the same: 


y= ; w'()=u(t)-u(t-1) 


7.2.4 Scaling of the Inputs and Outputs 
The observation vector ®(f) used in the parameter adaptation algorithm is built 
from the measurements y(t), y(t-/)... (or by variables correlated with the output) 
and u(t), u(t-Z)... 

D(A)" =[- y(t) -y(t-L).n(t)u(t-V] 


On the other hand, the adaptation gain F(A) is expressed as 


t 
FO) =>) oi No! (i +e ; <<] 
i=l 


If the level of u(t), u(t-1)... is very different from the level of (4), y(t-J), the gain 
matrix will be extremely unbalanced, thus resulting in significantly different 
convergence speeds for â; (t) and b,(t) f 

It is therefore convenient to scale the I/O files (by multiplying, if required, 
either u(t) or y(£)). This will result in the modification of the identified steady state 
gain. The values of the estimated parameters b; must therefore be divided or 


multiplied accordingly in order to obtain a model with a static gain corresponding 
to the real one. 


7.3 Selection (Estimation) of the Model Complexity 
This section discusses the determination of the delay (d) and the degrees of the 


polynomials A(q~), B(q“) and C(q ^). 
The “plant + disturbance” model to be identified is of the form 


Aq”) vt) = 9-4 Bq u(t) + wA) 
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where, according to the structures chosen, one has: 


w"'(t) = e(t) (7.3.1) 

w'(t) = AGWE) (7.3.2) 

w'(t) = Cq hele) (7.3.3) 

w(t) = = e(t) (7.3.4) 
Cq’) 


In order to start the parameter estimation methods, we need to specify 


and for structures [S3] and [S4] 


Nc =? 
where ny, ng and nc are the degrees of the polynomials Alq’), B(g") and Cq’ 
respectively. 

Remember that the order of a sampled-data system is given by n = max (ny, 
ngtd). 

Techniques for order estimation have been presented in Chapter 6, Section 6.5. 
If order estimation functions that allows the estimation of n = max (n4, ngtd), ny, 
ng and d, are available (like estimorderiv.sci (Scilab) and estimorderiv.m 
(MATLAB*)!, that estimate n), it is advisable to use them. Nevertheless the order 


estimation can also be done on the basis of “a priori” knowledge and a set of trials 
on the acquired data*. We give next details about this procedure. 


“A priori” Choice for n 4 
Two cases can be distinguished: 


1. Industrial plant (temperature control, flow rate, concentration, etc...). 
For this type of plant in general 


' Available from the book website. 
? This approach can be also used for a confirmation of the order estimation results obtained with the 
techniques described in Section 6.5. 
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and the value n4= 2, which is very typical, is a good starting value to 


choose. 
2. Electromechanical systems. 


n 4 results from the structural analysis of the system. 


Example: flexible transmission with two resonant modes. 
In this case, ny=4 is chosen, since a second-order is required to model each 


resonant mode. 


Initial Choice of d and ng 


If no knowledge of the time delay is available, d = 0 is chosen as an initial value. If 
a minimum value is known, an initial value d = d „in is chosen. 

If the time delay has been underestimated during identification, the first 
coefficients of B(q~/) will be very low. Thus 7 pg must then be chosen so that it can 


indicate the presence of the time delays and identify the transfer function 


numerator. np = (dmax - Amin) + 2 is then chosen as the initial value. At least two 
coefficients are required in B(q~) because of the fractional delay (see Section 
2.3.7). If the time delay is known, ng = 2 is chosen, however the value 2 is a good 


initial value. 


Initial Choice of nç 
As a general rule nç = ny is chosen. 


Determination of the Time Delay d (First Approximation) 
Method 1. One identifies the system using the RLS. The estimated numerator will 
be of the form 


Bq l) = buq lbg 2 4 bzq Bg 
If 
|< 0.15}, 


bj ~ 0 is considered, and time delay d is increased by 1: d = djy + J (since if bj = 


0, Bag) =! (bp q4+b3q¢°2)). 
If 


$, < 0.15ba «1 ; i=1,2.d,; 


288 Digital Control Systems 


time delay d is increased by d; d = d;, + d;. After these modifications, a new 


identification session is performed. 
Method 2. An identification of the system is performed with the RLS in order to 
obtain a model of the type “impulse response” 


w= > but) ; nN, =Large (20,...30) 


If there is a time delay, then 


b; 3 a 


< 01Sa 


From this time delay estimation, a new identification is performed to find a pole- 
zero model. 

Both these methods may of course be completed by a display of the step 
response. 

A more accurate estimation of time delay d is carried out by performing a new 
identification, followed by a validation of the identified model. Note that if the 
system is contaminated by measurement system noise an accurate estimation of the 
delay will only be carried out with the method that enables the identified model to 
be validated. 


Determination of (1.4) max and (NB) max 


The aim is to obtain the simplest identified model that verifies the validation 
criteria. This is linked on the one hand to the complexity of the controller (which 
will depend on nį and np), and, on the other hand, to the robustness of the 
identified model with respect to the operating conditions. 

From the results presented in Section 6.5, a first approach to estimate the values 
of (14) max Ad (1p) qx 1S to use the RLS and to study the evolution of the variance 


of the residual prediction errors, i.e. the evolution of 


1 wv 
R(0) = Ee @}= yoo 
i=l 
as a function of the value of n, + np. A typical curve is given in Figure 7.5. 


In theory, if the example considered is simulated and noise free, the curve 
should present a neat elbow followed by a horizontal segment, which indicates that 
the increase in parameter number does not improve the performances. (see Section 
6.5, Figure 6.5.1). 

In practice, this elbow is not neat if non-white noise is present. The practical 
test used for determining n, + ng is the following: consider first n4, ng and the 


corresponding variance of the residual errors R(0). Consider now ny’ =n, + 1, ng 
and the corresponding variance of the residual errors R'(0). 
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If 


R'(0) > 0.8R(0) 


it is unwise to increase the degree of n4 (same test with npg’ = np + 1). 


R(0) 


oe The good value 


1 2 3 4 5 6 7 n = (n+ Ng) 


par 


Figure 7.5. Evolution of the variance of residual errors as a function of the number of model 
parameters 


It is advisable to increase the values of n, and np in a non-simultaneous way. A 
simultaneous increase may induce the identification of a pair of very close poles 
and zeros that have a small influence on the criterion with respect to the increase of 
n4 OF Np but that could make the controller computation harder. 

With the choice that results for n , and np, the model identified by the RLS does 
not necessarily verify the validation criterion. Therefore, while keeping the values 
of n4 and np, other structures and methods must be tried out in order to obtain a 
“valid” model. If after all the methods have been tried none is able to give a model 
that satisfies the validation criterion, then n , and np must be increased. 

The estimated numerical values of the coefficients corresponding to the highest 
powers of polynomials Alq’) and Bq’) (after the estimation of the time delay 
d) also give a clue on the maximum order to be chosen. If these values are very 
small compared to the previous ones, it is often possible to reduce the order of 
Alq’) and B(q~') (one must obviously perform a new identification session with 
the updated orders). 

The order estimation techniques presented in Section 6.5 rapidly provide good 


results. Moreover, it is recommended to compare these results with the available a 
priori information upon the system structure. 
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7.4 Identification of Simulated Models: Examples: 


We consider now two files (TØ and T1) containing I/O data generated by a known 
discrete-time model. Each file contains 256 input/output recordings. In each case, 
the input has been a PRBS generated by a register with 8 cells (V = 8). The length 
of a complete sequence is therefore 2554. 

The file TØ has been obtained using the following model: 


ATYA = qB u(t) 
where 
Alq!) =1-1.5q7! +0.7¢7 


B(q"'!) =1q 7! +0.5q~ 


Plant Output 


L fi L fi 
50 100 150 200 250 


Plant Input 


r r r r 
: | li MUI | | | hil ll l 
al £ L ia L 

150 


50 100 200 250 
Samples 


0. 


a 


o 


a 


Figure 7.6. File TØ: I/O data set 


3 All the examples presented in this chapter have been worked out with WinPim (Adaptech) 
identification software and the MATLAB’/Scilab routines for model order estimation (see Section 
6.5.4). Small numerical differences will result when using other identification routines. 

4 These files are available from the book web sites: http://landau-bookic.lag.ensieg.inpg.fr. 
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The file T1 has been generated with the same polynomials A(q~/) and B(q-/), but 
adding a stochastic disturbance, the ARMAX model being of the form 


A(q"') y(t) =q Bq u(t) + Clq helt) 


in which {e(¢)} is an almost white noise generated by the computer and the degree 
of Cq) is nç =2. 


FILE TØ 

We now come back to the file TØ. Figure 7.6 shows the input and output 
sequences collected in this file. For the file TØ, by using the recursive least 
squares (RLS) method with the decreasing adaptation gain, the following results 
are obtained: 


S=1 M= 1(RLS) A=1 FILE: T0 DELAY D=1 
INSTANT K =50 
FORGETTING FACTOR =1 
TRACE OF ADAPTATION GAIN = 7.106747E-02 
PROCESS OUTPUT = -5.030791 
MODEL OUTPUT = -5.030789 
PROCESS INPUT =-] 
ADAPTATION ERROR = -1.430511E-06 
A(1) = -1.49999 B(1) = 0.99998 
A(2) = 0.69999 B(2) = 0.50000 


where S, M, and A designate the structure, the method and the type of the 
adaptation gain® (see Chapter 5, Sections 5.5 and 5.2.4) respectively. A(/), A(2), 
B(1), B(2) designate the estimated coefficients of polynomials A(q~/) and B(q~’). It 
can be observed that the estimated parameters converge very fast towards the good 
values in the case of a noise free system (initial values A(/) = A(2) = BU) = B(2) 
0). 

Similar results are obtained with the output error method, with fixed 
compensator, decreasing adaptation gain and compensator degree np=0 


(adaptation error = prediction error), as indicated below. 


S=2 M=2(OEFC) A=1  FILE:T0  DELAYD=1 
INSTANT K = 50 
FORGETTING FACTOR = 1 

TRACE OF ADAPTATION GAIN = 7.107091E-02 
PROCESS OUTPUT = -5.030791 
MODEL OUTPUT = -5.031748 
PROCESS INPUT =-] 
ADAPTATION ERROR = 9.570122E-04 
A(1) = -1.50000 B(1)= 1.00002 
A(2) = 0.700000 B(2) = 0.49993 


> Before starting the identification, data must be centred. 
6 s=] designates the structure S1, M=/ designates the first method used for the structure S1 (see 
Section 5.5) and A=/ corresponds to the choice of the adaptation gain A.1 discussed in Section 5.2.4. 
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The estimation of the time delay for the file TØ in the absence of a priori 
information will be illustrated next. Indeed with the recursive least squares method 
and a decreasing adaptation gain, for ny = 2, ng = 4 and d = 0 the following 


parameters are obtained: 


S=1 M=1(RLS) A=1 FILE: TO DELAY D=0 
INSTANT K =50 
FORGETTING FACTOR =1 
TRACE OF ADAPTATION GAIN = 1623274 
PROCESS OUTPUT = -5.030791 
MODEL OUTPUT = -5.030764 
PROCESS INPUT =-] 
ADAPTATION ERROR = -2.717972E-05 
A(1) = -1.49998 B(1) = 5.39346E-06 B(3) = .50001 
A(2)= .699984 B(2) = .99998 B(4) = 2.62828E-05 


The results obtained (B(/) and B(4), very small compared to B(2) and B(3)) clearly 
show that d = J and np = 2. However it must be stressed that this situation is 


without any ambiguity in this example, since there is no disturbing noise. 


FILE T] 
The file T1 is highly contaminated by noise and certain methods (in particular the 
recursive least squares) will give biased parameter estimates. The quality of the 
identification will be reflected in the validation results. The estimation has been 
carried out on 256 samples and the validation has been carried out on the same 
input/output data set. 

The results obtained with the recursive least squares with decreasing gain are 
given below’: 


S=1 M=1 (RLS) A=1 FILE: Tl NS=256 DELAY D=1 
COEFFICIENTS OF POLYNOMIAL A: A(1) = -1.403533 
A(2) = 0.6066453 
COEFFICIENTS OF POLYNOMIAL B: BC) = 0.9831312 
B(2)= 0.6512049 
VALIDATION TEST : Whiteness of the residual error 
System Variance: 18.3791 Model Variance: 17.9035 
Error variance R(0): 0.4749 
NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion: Theor. Val.: |RN(i)| < 0.136, Pract. Val.: |RN(@)| <0.15 
RN(0) = 1.000000 > RN(1) = -0.505234 € 
RN(2) = 0.115732 RN(3) = -0.054398 
RN(4) =0.016311 


The appearance of a bias on the estimated parameters is observed, which is also 
reflected in unsatisfactory validation results (|RN(/)| > 0.15). The residual 
prediction error is not close to white noise. One should thus consider another “plant 


7 In the tables shown in this section the system variance corresponds to the variance of the measured 
output, the model variance corresponds to the variance of the predicted output and the error variance 
corresponds to the variance of the residual prediction error (R(0)). 
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+ disturbance” structure such as, for example, the S3 structure, which replaces the 
disturbance model e(t) in S1 by c(i) e(t). 

We choose, among the identification methods applicable to structure S3, the 
output error method with extended estimation model (M3) and decreasing 
adaptation gain (A1). The results obtained are given in the following table. 


S=3 M=3(OEEPM) A=1 FILE:T1 NS=256 DELAY D=1 
COEFFICIENTS OF POLYNOMIAL A A(1) = -1.50009 
A(2) = 0.69614 
COEFFICIENTS OF POLYNOMIAL B B(1)= 0.95782 
B(2) = 0.54005 
COEFFICIENTS OF POLYNOMIAL C C(1) = -0.83917 
C(2) = 0.05308 
VALIDATION TEST: Whiteness of the residual error 
System Variance: 18.3791 Model Variance: 18.1894 
Error variance R(0): 0.2571 
NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion: Theor. Val.: |RN(i)| < 0.136, Pract. Val.: |RN(G)| <0.15 
RN(O) = 1.000000 RN(1) = -0.141702 
RN(2) = 0.021206 RN(3) = 0.008497 
RN(4) = 0.051014 


It can be observed that the estimated values of A(/), A(2) and B(2) are better than 
in the case of the recursive least squares (the sum of the squared biases is lower in 
this case). On the other hand, the validation results are acceptable since all the 
normalized autocorrelation functions (RN(1) to RN(4)) have a module less than 
0.15. The residual prediction error becomes closer to white noise and its variance 
has been reduced compared to estimation using the recursive least squares. 

The results obtained can be further improved if the output error with extended 
estimation model, and an adaptation gain with variable forgetting factor are used 
(A3 with 4,(0) = 0.97). The following results are obtained: 


S=3 M=3(0.E.E.M.P.) A=3 FILE:Tl1 NS=256 DELAY D=1 


COEFFICIENTS OF POLYNOMIAL A: A(1) = -1.508445 
A(2) = 0.70574 
COEFFICIENTS OF POLYNOMIAL B: B(1)= 0.95120 
B(2) = 0.52940 
COEFFICIENTS OF POLYNOMIAL C: C(1) = -0.90610 
C (2) = 0.08344 
VALIDATION TEST: Whiteness of the residual error 
System Variance: 18.3791 Model Variance: 18.2276 
Error variance R(0): 0.2531 
NORMALIZED AUTOCORRELATION FUNCTIONS 


Validation Criterion: Theor. Val.: |RN(i)| < 0.136, Pract. Val.: |RN(@)| <0.15 
RN(0) = 1.0000 RN(1) = -0.091665 
RN(2) = 0.032701 RN(3) = 0.025042 
RN(4) = 0.064717 


which corresponds to an improvement of the results in terms of whiteness and 
variance of the residual prediction error, on the one hand, and in terms of the sum 
for the squared biases, on the other hand. 
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Better results than those obtained with the recursive least squares method can 
also be obtained with structure S2 by using the output error method with fixed 
compensator, decreasing adaptation gain and compensator degree np=0 


(adaptation error = prediction error). The results obtained are given below: 


S=2 M=2(OEFC) A=1 FILE:T1 NS=256 DELAY D=1 


COEFFICIENTS OF POLYNOMIAL A A(1) = -1.52885 
A(2) = .73410 
COEFFICIENTS OF POLYNOMIAL B BC) = .93228 
B(2) = .51900 
VALIDATION TEST: Error / prediction uncorrelation 
System variance: 18.3791 Model variance: 18.5921 
Error variance R(0): 0.4860 
NORMALIZED AUTOCORRELATION FUNCTIONS 


Validation Criterion: Theor. Val.: |RN()| < 0.136, Pract. Val.: |RN(@)| < 0.15 
RN(0) = -0.116266 
RN(1) = -0.028968 
RN(2) = 0.103195 


One can see that the values obtained for the normalized cross-correlations satisfy 
the validation condition. 

However, it is interesting to compare these results with those provided by the 
model identified with recursive least squares for the same validation test. 


S=1 M=1 (RLS) A=1 FILE:T! NS=256 DELAY D=1 
COEFFICIENTS OF POLYNOMIAL A A(1) = -1.403533 
A(2) = 0.6066453 
COEFFICIENTS OF POLYNOMIAL B B(1) = 0.9831312 
B(2) = 0.6512049 
VALIDATION TEST: Error / prediction uncorrelation 

System variance: 18.3791 Model variance: 18.5921 

Error variance R(0): 0.76355 

NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion: Theor. Val.: |RN(i)| <0.136, Pract. Val.: |IRN(i)| < 0.15 

RN(O) = 0.248184 
> RN(1) = 0.313691 € 
> RN(2) = 0.284383 € 


It is observed that the parameters estimated by the output error method with fixed 
compensator are better than those obtained by the recursive least squares (the latter 
do not satisfy the validation criterion). 

This is also confirmed by the validation results (the model identified with 
recursive least squares does not pass the uncorrelation test). 

Finally it can be shown that, even in the presence of significant noise, the time 
delay can be determined from the relative values of the coefficients of the 
polynomial B(q~). The following results are obtained for d = 0, n p= 3,Nn4 = 2, by 


using the recursive least squares method: 
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S=1 


M=I(RLS) A=l1 File:Tl DELAY D=0 
INSTANT K =256 
FORGETTING FACTOR = 1 
TRACE OF ADAPTATION GAIN = 1,574461E-02 
PROCESS OUTPUT = 1139311 
MODEL OUTPUT = 11.06473 
PROCESS INPUT =-1 
PREDICTION ERROR = 0.3283825 
A(1) = -1.4043 B(1) = -5.39615E-02 
A(2) = 0.60742 B(2) = .98315 
B(3) = .65067 


One observes that |B(/)| < 0.15 |B(2)|. This leads to choose d = J and ng = 2. 


Exercise: Compare the model obtained using the output error with fixed 
compensator (S = 2, M = 2) with the model obtained using output error with 
extended estimation model (S = 3, M = 3). See Chapter 6, Section 6.4 for the 
comparison procedure. 

If techniques for the model complexity estimation are used, (by using the error 
criterion of Equation 6.5.17 and the criterion for the complexity estimation of 
Equation 6.5.19) a minimum of the criterion is obtained for n = max(n4,ngt+d)= 3, 


that is indeed the good value (see Figure 7.7). The function estorderiv.m has been 
used. A detailed estimation of the complexity leads to ny = 2, ng = 2 andd = 1. 


0.25 s 


File T1 : Model Complexity Estimation 
T T r 


Į 


T 
— Eror criterion (IV) 
+ Complexity estimation criterion 


Complexity (order) 


Figure 7.7. Estimation of the model complexity (n=max(n,,npgtd)) from the data collected 


in the file T1 
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7.5 Plant Identification Examples 


7.5.1 Air Heater 


The diagram of the system is represented in Figure 7.8. The air is heated at the pipe 
input by means of an electrical resistor supplied by a power amplifier. The 
temperature of the air at the output is measured by a thermocouple. This section is 
concerned with identifying the dynamic model linking the power amplifier control 
to the temperature of the output air, around a certain temperature. The steady state 
characteristic of the air heater + power amplifier is very non-linear. This results in 
the appearance of a DC component at the output even for centered input signals of 


low magnitude. 
temperature 
measurement 


power 


t tf 


amplifier 


Figure 7.8. Schematic representation of the air heater (Laboratoire d’Automatique de 
Grenoble INPG/CNRS) 


The data acquisition has been carried on around an operating point 
corresponding to an output temperature of 60° and a DC input signal u9=5V (vo(t) 
= 3.2V). 

he file AERO.dat contains 128 raw input/output data obtained with a sampling 
period of 5 s. The input was a PRBS generated with a length register equal to 6 and 
a clock frequency f/2 (sequence length: 126 samples). The raw data file was 
centered. The I/O data set relative to the centered file AERO.c* is shown in Figure 
7.9. 


A first identification is started up, using the S1 structure and the recursive least 
squares method M1 with decreasing adaptation gain. Since this is a thermal system, 
n4 = 2 can be a good initial choice. On the other hand d = 0 (no prior knowledge 


on the delay) and np = 2. The following results are obtained: 


8 Available from the web site: http:/landau-bookic.lag.ensieg.inpg fr 
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S=1 M=1(RLS) A=1 FILE: AERO.C NS=128 DELAY D=0 
COEFFICIENTS OF POLYNOMIAL A: A(1) = -0.66872 
A(2) = 0.00115 


COEFFICIENTS OF POLYNOMIAL B: BC) = 0.17360 
B(2) = _ 0.05424 


The system clearly has a time delay less than 0.5 T, (since |b,|>|b2| ), thus the 
choice d=0 was a good one. As the coefficient A(2) has a very small value 
(resulting from the product of poles) one can say that the value of one of the poles 
is very small and it can be neglected. 


Plant Output 
0.15 T T T T T 


1 1 L L L fi 
20 40 60 80 100 120 


Plant Input 


T T T T T 


1 1 f 
20 40 60 80 100 120 
Samples 


Figure 7.9. File AERO.c: I/O data set 


This model structure is also compatible with the complexity estimation 
provided by the functions estorderiv.m (MATLAB®) or estorderiv.sci (Scilab) 
(estimation with the method of instrumental variable with delayed inputs) that 
gives n = max (n4,ngtd) = 2 and n,=I, ng=2, d=0 respectively (see Figure 7.10). 

Another identification is thus carried out with the same structure, method and 
adaptation gain, but with np=2, d=0, n4=!. 

The results obtained are as follows: 


S=1 M=1 (RLS) A=1 FILE:AERO.C NS=128 DELAY D=0 
COEFFICIENTS OF POLYNOMIAL A: A(1)= -0.6672 
COEFFICIENTS OF POLYNOMIAL B: B(1)= 0.1736 


B(2)= 0.0545 
VALIDATION TEST: Whiteness of the residual error 
System variance: 0.0035 Model variance: 0.0034 


Error variance R(0): 3.991 E-04 
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NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion:Theor. Val.:|RN(i)| < 0.192, Pract. Val.: |RN(i)| < 0.15 
RN(O) = 1.000000 > RN(1) = -0.2284 © 
RN(2) = 0.1 RN(3) = 0.017 
RN(4) = 0.0054 


Air Heater : Model Complexity Estimation 
0.25 : i 


T 
— Error criterion (IV) 
++ Complexity estimation criterion 


0.2} 


0.15} 


0.1; 


0.05}- 


0 1 2 3 4 
Complexity (order) 


Figure 7.10. Complexity estimation for the air heater model based on the data file AERO.c 


The result of the validation is not acceptable. The results of the identification 
can be further improved by taking into account the fact that disturbances are 
present. A first approach is to choose structure S3 with the method M3, the output 
error with extended prediction model, which gives also an estimation of the model 
of disturbances. The following results are obtained (with decreasing adaptation 


gain): 


S=3 M=3 (O.E.E.M.P) A=1 FILE:AERO.C NS = 128 DELAY D=0 
COEFFICIENTS OF POLYNOMIAL A: A(1)= -0.6589 
COEFFICIENTS OF POLYNOMIAL B:  B(1)= 0.1724 
B(2) = 0.0579 
COEFFICIENTS OF POLYNOMIAL C:  C(1) = -0.1248 
VALIDATION TEST: Whiteness of the residual error 

System variance: 0.00351 Model variance: 0.00346 

Error variance R(0): 3.837E-05 

NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion:Theor. Val.:|RN(i)| < 0.192, Pract. Val.: |RN(@)| < 0.15 

RN(0)= 1.000000 RN(1)= 0.1303 

RN(2) = 0.1029 RN(3) = 0.0192 

RN(4) = 0.0326 


The results of the validation are without doubt satisfactory. 
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Air Heater : Step Responses 


Time (tT) 


Figure 7.11. Step response for the models identified in the air heater example: 
OEEPM - output error with extended prediction model, variable forgetting factor, d = 0, nA 
= 1, ng = 2; OEFC - output error with fixed compensator, d = 0, na = 1, ng = 2 


The step response for this model is shown in Figure 7.11 (OEEPM). Structure 
S2 can also be used, which may lead to an asymptotically unbiased estimated 
model without modeling the disturbances. The output error with fixed compensator 
(method M2) is chosen with np=0 (because n,=/), and with an adaptation gain 
with forgetting factor (4 (0) = 0.97 ). The results are summed up in the following 


table: 


S=2 M=2(OEFC) A=3 FILE: AERO.C NE=128 DELAY D=0 
COEFFICIENTS OF POLYNOMIAL A: A(1)= -0.6837 
COEFFICIENTS OF POLYNOMIAL B: B(1)= 0.1771 B(2)= 0.043 
VALIDATION TEST: Error / prediction uncorrelation 

System variance: 0.00351 Model variance: 0.00317 

Error variance R(0): 9.77 E-05 

NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion:Theor. Val.:|RN(i)| < 0.192, Pract. Val.: |RN(@)| < 0.15 

RN(0)= -0.2208 RN(1)= 0.1508 

RN(2)= 0.0432 RN(3)= 0.0116 

RN(4)= 0.0469 


The step response for this model, which has passed the validation test, is presented 
in Figure 7.11 (OEFC). The model obtained with the output error with fixed 
compensator has a static gain and a rise time slightly larger than the corresponding 
values for the previous model (a larger rise time means that the identified model is 
slower). 
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In this case, in order to compare further the quality of the two models, the 
model identified with the output error with extended prediction model should also 
be validated by the uncorrelation test. This test gives the following results: 


S=3 M=3 (OEEPM) A=1 FILE: AERO.C NS=128 DELAY D=0 


COEFFICIENTS OF POLYNOMIAL A: A(1)= -0.6589 
COEFFICIENTS OF POLYNOMIAL B:  B(1)= 0.1724 


B(2)= 0.0579 
VALIDATION TEST: Error / prediction uncorrelation 
System variance: 0.00351 Model variance: 0.00317 


Error variance R(0): 1.02E-04 
NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion:Theor. Val.: |RN(G)| < 0.192, Pract. Val.:|RN(i)| < 0.15 
RN(0)= - 0.2154 RN(1) = - 0.1465 
RN(2) = - 0.1033 RN(3)= - 0.1094 
RN(4) =_ - 0.1769 


Both models are validated and the results are very close. 
As the models identified have the same quality, one of them will be used to 
compute the controller and the result of the design will be tested on both models. 


7.5.2 Distillation Column 


The diagram of the binary column (water-methanol), which is the subject of the 
identification, is given in Figure 7.12a and a view of the plant is shown in Figure 
7.12b. 

The control variables are the heating power (QB) and the reflux rate (R). The 
flow rate (LF) and concentration (XF) of the input product are assumed constant 
(their variations produce disturbances in the system). The controlled variables are 
the flow rate of the top product (LD) and the concentration of the top product (XD). 
(7) designate the temperature and (LB) the flow rate of the product at the bottom. 
The corresponding block diagram is given in Figure 7.13. 

The input and output variations will be related around an operating point by a 
linear model characterized by a 2 x 2 transfer matrix operator 


pa a Ay(q') Hy(q"') l R EM 

XD] |Ha") Hy(q") OB] |w 

where w; and w, represent the unmodeled disturbances. Each element of the 
transfer matrix operator is of the form 


q’ (bq + bq” + n) 


Ay(q')= 
l+aq” + aq” Fis 
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Figure 7.12a,b. Binary distillation column (Laboratoire d'Automatique de Grenoble, 
INPG/CNRS). a Functional diagram, b View 
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that corresponds to a model of the form: 


A(q7')y(t) =q B(q"' u(t) + w(t) 


(reflux 
rate) (fow) 
PLANT 
oe 1 oe 
(heating (concentr.) 
power) 


Figure 7.13. Block diagram of the distillation column (inputs-outputs) 


Henceforward we shall be concerned with the identification of the transfer 
between the heating power (QB) and the concentration of the top product (XD). 
The input/output file is named QXD” file. It contains an I/O data set made of 256 
samples. The input is a pseudo random binary sequence generated with a register 
with 8 cells (N = 8, L = 255). Figure 7.14 displays the inputs and outputs of the 
centered QXD file. The sampling period was 10 s. 

The identification procedure starts after having centered the I/O sequences. As 
no prior knowledge of the system is available, first we choose structure S1, the 
recursive least squares method (M1) with a decreasing adaptation gain Al, delay 
d=0, degree for the polynomial B: np = 4 (in order to capture a possible time delay 


of the system) and degree for the polynomial A: n, = 2 (since it is a chemical 


plant). The initial value of the parameters to be estimated is set to zero. The results 
obtained with this method are summarized below: 


S=l M=1(RLS) A=1 FILE:QXD NS=256 DELAY D=0 
INSTANT K = 256 
FORGETTING FACTOR =] 

COEFFICIENTS OF POLYNOMIAL A: A(1) = -0.23644 

A(2) = -0.21889 

COEFFICIENTS OF POLYNOMIAL B:  B(1)= 0.01177 

B(2) = 0.07982 
B(3) = 0.18311 
B(4) = 0.13271 


Note that B(/) < 0.15 B(2). This shows that we have to set the delay d equal to 1, 
as a first approximation. 


° Available from the book website http://landau-bookic.lag.ensieg.inpg.fr. 
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QXD Output 


QXD Input 
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Figure 7.14. I/O data set for the distillation column QXD 
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Thus a new identification is performed with d = 1, ng = 3, n4 = 2 and the 


results obtained are 


S=1 M=1(RLS) A=1 FILE: QXD NS=256 DELAY D=1 


COEFFICIENTS OF POLYNOMIAL A A(1) = -.23806 
A(2) = -.18820 
COEFFICIENTS OF POLYNOMIAL B B(1)= .07982 
B(2)= .18303 
B(3)= .13244 
VALIDATION TEST: Whiteness of the residual error 
System variance: 0.0542 Model variance: 0.0274 
Error variance R(0): 0.0268 
NORMALIZED AUTOCORRELATION FUNCTIONS 


Validation Criterion:Theor. Val.: |RN(i)| < 0.136, Pract. Val.: |JRN(i)| <0.15 
RN(0)= 1.0000 RN(1) = -0.1216 
> RN(2)= -0.2278 € RN(3)= 0.0112 
RN(4) = 0.0718 


It is observed that the validation is unsatisfactory since the residual error is not 
sufficiently white ([RN(2)|) > 0.15). We may consider that this situation arises from 
the fact that the disturbances are incorrectly modeled by the structure S1. A 
different structure (S3) and the output error method with extended estimation 
model (M3), still with decreasing adaptation gain, are then tried. In this way a 


disturbance model will be identified. The results obtained are 
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S=3 M=3(OEEPM) A=1 FILE:QXD NS = 256 DELAY D=1 


COEFFICIENTS OF POLYNOMIAL A A(1) = -.5065 
A(2) = -.1595 
COEFFICIENTS OF POLYNOMIAL B BC) = 0.0908 
B(2)= .1612 
B(3) = .0776 
COEFFICIENTS OF POLYNOMIAL C C(1) = -.4973 
C(2) =-.2593 
VALIDATION TEST: Whiteness of the residual error 
System variance: 0.0542 Model variance: 0.0308 
Error variance R(0): 0.0231 
NORMALIZED AUTOCORRELATION FUNCTIONS 


Validation Criterion:Theor. Val.: |RN(i)| < 0.136, Pract. Val.: |RN(i)| < 0.15 
RN(O) = 1.000000 RN(1) = -0.0241 
RN(2) = -0.0454 RN(3) = 0.0518 
RN(4) = 0.1014 


The validation results obtained are very good. This is therefore a representative 
model. Figure 7.15 gives the step response for this model with ny, = 2 (gain 


normalized to 1). The analysis of this response shows that the rise time is tp ~ 70 
T, (with a delay d = 7). On the other hand, since the number of cells of the 


generator register of the PRBS is N = 8, the duration of the largest pulse is less 
than tr. The validation will thus not be significant for the steady state gain (several 


models may be validated without their steady state gain being the same). A direct 
verification of the steady state gain shows that the value obtained (0.987) is 
correct. 

Note also that the polynomial B(q~) is unstable, B(/) < B(2) revealing the 
presence of a fractional delay greater than 0.57, (which explains the presence of an 


unstable zero). 
As the coefficient A(2) is small if compared to A(/) and the validation results 
are very good, one may think of identifying a new model with n,=/. In this case 


the results are 


S=3 M=3(OEEPM) A=1 FILE:QXD NS =256 DELAY D=1 
COEFFICIENTS OF POLYNOMIAL A A(1) = -.7096 
COEFFICIENTS OF POLYNOMIAL B B(1)= .0839 
B(2)= 0.1415 
B(3) = 0.0528 
COEFFICIENTS OF POLYNOMIAL C C(1) = -.688 
VALIDATION TEST: Whiteness of the residual error 

System variance: 0.0542 Model variance: 0.02952 
Error variance R(0): 0.0227 
NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion:Theor. Val.: |RN(i)| < 0.136, Pract. Val.: |RN(i)| < 0.15 
RN(0)= 1.0000 RN(1) = -0.0035 
RN(2) = -0.0748 RN(3) = -0.0131 
RN(4) = 0.0442 
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Distillation Column : Step Responses 


I I 
0) ee a ee ie lei ei eid ete tT OEEPM ny=2 H 
— OEEPM n,=1 
1 I I I 
I 1 1 I 
Redes T 
1 1 1 
| 1 1 1 
1 1 1 I 
1 I I 1 
pre n” pree apr eh ARRIE 
1 | 1 l 
1 I 1 1 
I 1 1 1 
| 1 I I 
POSS Pore pms 
1 I 1 I 
1 I 1 1 
I 1 I 1 
| 1 I 1 
+---+---+---+---4 
1 I 1 I 
1 I 1 1 
1 I 1 l 
| 1 I 1 
Poo poe bore bese 
1 1 I 1 
I 1 1 I 
1 I 1 I 
1 | 1 1 
1 1 t t 
12 14 16 18 20 


Time (tT) 


Figure 7.15. FIle QXD: normalized step responses for the two models identified (static gain 
normalized to 1) 


The model obtained is validated. The static gain of the model is 0.958. It will 
be necessary to scale the values of the coefficients of the polynomial B(g~) in 
order to obtain the static gain previously obtained (nevertheless the difference 
found between the two static gain can be neglected). 

The normalized step responses of both models are presented in Figure 7.15. 


7.5.3 DC Motor 


The identification of a DC motor model is examined in this section. The input of 
the system is the voltage applied to a power amplifier that feeds the motor, and the 
output is the speed measured by means of a tachometer. A short description of the 
global system is shown in Figure 7.16. From the identification point of view, let 
us consider the cascade power amplifier, motor, tachometer, filter on the measured 
output as the plant. 

The file MOT3.c!” contains 256 centered I/O data obtained with a sampling 
period of 15 ms. The input is a PRBS generated by a shift register with seven cells 
and a clock frequency f/2 (sequence length: 254). 


10 Available from the website: http://landau-bookic.lag.ensieg.inpg.fr. 
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Figure 7.16. Schematic representation of a DC motor and other external elements 
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Figure 7.17. I/O data set for the DC motor (MOT3.c) 


The magnitude of the PRBS is set to 0.3 V and applied when the operating 
point of the system is an input voltage of 3V (scales for u: 0-10V corresponding to 
a speed variation from 0 to +1500 rpm). This file is shown in Figure 7.17. 

The result of the complexity estimation algorithm (instrumental variable with 
delayed inputs method using estorderiv.sci or estorderiv.m) is (see Figure 7.18) 


n = max (nynptd) = 2 


The detailed complexity estimation gives the values n, = J, ng = 2, d = 0. This 


complexity is coherent with the model obtained from physical equations that 
describe the DC motor, with at most two time constants, but the electrical time 
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Figure 7.18. Model complexity estimation for the DC motor (input: voltage, output: speed) 
using the data file MOT3.c 


constant in this case is very small if compared to the electro-mechanical one. The 
absence of a pure time delay is not surprising as well. The degree of the 
polynomial B , ng = 2 reveals the presence of a fractional delay as a result of the 


filtering action on the measure. 

A first identification is carried on with structure S1 and the recursive least 
squares (M1) with a decreasing adaptation gain (A1), the following results are 
obtained: 


S=1 M=1(RLS) A=1 FILE:MOT3.c NS=256 DELAY D=0 
COEFFICIENTS OF POLYNOMIAL A A(1) = - 0.5402 
COEFFICIENTS OF POLYNOMIAL B BC) = 0.2629 
B(2)= 0.2257 

VALIDATION TEST: Whiteness of the residual error 

System variance: 0.0412 Model variance: 0.041 

Error variance R(0): 1.157 E-4 

NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion:Theor. Val.:|RN(i)| < 0.136, Pract. Val.: |RN(@)| < 0.15 


RN(0) = 1.0000 > RN(1) = - 0.4529 € 
RN(2) = 0.3113 RN(3) = 0.0332 
RN(4) = - 0.0297 


The model obtained is not validated. Next an identification with the structure S3 is 
performed by using the output error with extended prediction model method (M3) 
that simultaneously estimates the plant model and the disturbance model with the 
choice nc = J (a decreasing adaptation gain is still used). In this case the results are 
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S=3 M=3 (OEEPM) A=1 FILE:MOT3.c NS=256 DELAY D=0 
COEFFICIENTS OF POLYNOMIAL A A(1) = - 0.5372 
COEFFICIENTS OF POLYNOMIAL B BC) = 0.2628 
B(2) = 0.2273 
COEFFICIENTS OF POLYNOMIAL C C(1) = 0.3808 
VALIDATION TEST: Whiteness of the residual error 
System variance: 0.0412 Model variance: 0.041 
Error variance R(0): 1.004 E-04 
NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion:Theor. Val.:|RN(i)| < 0.136, Pract. Val.: |RNG)| < 0.15 
RN(0)= 1.0000 RN(1) = - 0.0144 
-> RN(2)= 0.3414 <-- RN(3)= 0.0952 
RN(4) = 0.0399 


It can be observed that the model obtained is not validated too. If the choice nç = 1 


does not allow one to model suitably the effects of disturbances on the system (as 
RN(2) still has a large value), it is advisable to perform a new identification with 
no = 2. 

The following results for the whitening test on the residual prediction errors 
and for the uncorrrelation test between the output error and the output prediction 
are found: 


S=3 M=3(OEEPM) A=1 FILE:MOT3.c NS=256 DELAY D=0 
COEFFICIENTS OF POLYNOMIAL A A(1)= - 0.535 
COEFFICIENTS OF POLYNOMIAL B- B(1)= 0.2617 B(2) = 0.2288 
COEFFICIENTS OF POLYNOMIAL C C(1) =- 0.84848 C(2)= 0.19255 
VALIDATION TEST: Whiteness of the residual error 
System variance:0.0042 Model variance:0.041 Error variance R(0): 8.856 E-05 
NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion:Theor. Val.:|RN(i)| < 0.136, Pract. Val.: |RN(@)| < 0.15 
RN(O)= 1.0000 RN(1)= - 0.0432 RN(2)= 0.0404 
RN(3)= 0.0453 RN(4)= 0.01179 
VALIDATION TEST: Error / prediction uncorrelation 
System variance:0.0412 Model variance:0.0408 Error variance R(0): 2.71 E-04 
NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion:Theor. Val.:|RN(i)| < 0.136, Pract. Val.: |RNG)| < 0.15 
RN(0) = 0.0119 RN(1) = 0.0156 RN(2) = 0.0284 
RN(3) = 0.0356 RN(4) = 0.0186 


Both the whitening test and the uncorrelation test give good values. Thus the model 
identified is validated. Another structure and method can be tested nevertheless 
with the same model complexity. If the structure S2 and the output error with fixed 
compensator method (M4) are chosen, in order to obtain an asymptotically 
unbiased estimation without estimating the disturbance model, one gets (d =0) 


S=2 M=4(OEFC) A=1 FILE:MOT2C NS=256 DELAY D=0 
COEFFICIENTS OF POLYNOMIAL A A(1) = - 0.5347 
COEFFICIENTS OF POLYNOMIAL B B(1) = 0.2629 


B(2)= 0.2266 
VALIDATION TEST: Error / prediction uncorrelation 
System variance: 0.0412 Model variance: 0.0406 


Error variance R(0): 2.723 E -04 
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NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion:Theor. Val.: |RN(i)| < 0.136, Pract. Val.:|RN(i)| < 0.15 
RN(0) = 0.043 RN(1) = 0.0591 RN(2) = 0.0631 
RNG) =0.0564 | RN(4) =0.031 


Note that the results of the validation are very good, but slightly worse than those 
obtained with the output error with extended prediction model method. However, 
the parameters obtained in these two cases are very close. The step responses 
obtained using these models are extremely close each other and are shown in 
Figure 7.19. 


DC Motor : Step Responses 
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Figure 7.19. Step responses for the identified DC motor models (Output error with extended 
prediction model and output error with fixed predictor, d= 0, na = 1, np = 2) 


7.5.4 Flexible Transmission 


In this example the dynamic model of a flexible transmission, with low damped 
resonant modes, will be identified for control design purposes. A view of the 
flexible transmission is given in Figure 7.20 and the schematic representation of 
the control system is shown in Figure 7.21. 

The flexible transmission is made of three pulleys linked by two elastic belts 
(see Figure 7.20). One of these pulleys is constrained to the axis of a DC motor. 
The motor position is controlled by a local servo (speed and position feedback). 
The dynamics of the local position control is very fast if compared to the 
mechanical system. 

The control problem is to get the desired position of the third pulley, by 
modifying the input voltage of the position control of the motor that drives the first 
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pulley. The output y(f) of the system is the axis position of the third pulley, and the 
command signal u(f) is the reference for the first pulley axis position. The 
mechanical loads that can be added on the third pulley modify the system inertia 
and, consequently, also the resonant modes of the mechanical system. 

We are concerned in the following with the open loop identification of the 
model for this process (between u(t) and y(t)) for the case without additional load 
(the controller in Figure 7.21 is not connected). 

The sampling frequency is 20 Hz (T, = 50ms). The excitation signal is a PRBS 
of small magnitude generated by a shift register with N = 7, and with a frequency 
divider p = 2. In the file poulbol.c 254 I/O samples are stored after removal of DC 
component. The data stored in the file poulbo1.c/are plotted in Figure 7.22. 

The system has two resonant modes and then a possible choice is nį = 4. 
However, an estimation of the order for the model can be carried on by using 
techniques presented in Chapter 6, Section 6.5. 

The results obtained (with the functions estorderivm (MATLAB®) or 
estorderiv.sci (Scilab)) are shown in Figure 7.23, thus confirming that the order for 
the model to be chosen is 


n=max(n4,np+d)=4 


A detailed order estimation (using WinPim) gives the values n4 = 4, np = 2, 
d= 2. 
The estimation of the delay can be verified by identifying with the RLS, with n, = 
np=4,d=0. 

The results obtained are 


S=1 M= IRLS) A =1 FILE: POULBOI.C DELAY D=0 
A(1) = -1.5752 B(1) = 0.0104 
A(2) = 1.8384 B(2) = 0.0098 
A(3) = -1.4788 B(3) = 0.3077 
A(4) = 0.8896 B(4) = 0.4146 


Note that |B(/)|, |B(2)| << 0.15|B(3)|, and that clearly implies d = 2. 


11 Available from the website: http://landau-bookic.lag.ensieg.inpg. fr. 
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Figure 7.20. View of the flexible transmission (Laboratoire d’Automatique de Grenoble 
INPG/CNRS/UJF) 
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Figure 7.21. Control scheme for the flexible transmission 
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Figure 7.22. I/O data used for the identification of the flexible transmission 
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Figure 7.23. Complexity estimation for the flexible transmission model based on the file 
poulb01.c 
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If a new identification is performed with d = 2, ng = 2, ny = 4 by using 
structure S1 and the recursive least squares methods, one gets the following results: 


S=1 M=1 (RLS) A=1 FILE: POULBOI.C NS=254 DELAY D=2 
COEFFICIENTS OF POLYNOMIAL A: A(1) = -1.5748 
A(2) = 1.8329 
A(3) = -1.4784 
A(4)= 0.8895 
COEFFICIENTS OF POLYNOMIAL B: B(1)= 0.3010 
B(2) = 0.4181 
VALIDATION TEST: Whiteness of the residual error 
System variance: 0.3317 Model variance: 0.1053 Error variance R(0): 
0.0007 
NORMALIZED AUTOCORRELATION FUNCTIONS 
Validation Criterion: Theor. Val.: |RN(i)| < 0.136, Pract. Val.: |RN(i)| < 0.15 
RN(0)= 1.0000 > RN(1)= -0.5727 € 
> RN(2)= 0.2360 € RN(3)= -0.0475 
RN(4)= -0.0158 


Flexible Transmission : Magnitude Bode Diagrams 
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Figure 7.24. Frequency characteristics of the models identified for the flexible transmission 
(RLS — recursive least squares, OEEPM — output error with extended prediction model) 


The validation is not satisfactory as RN(/), RN(2) are greater than 0.15. The 
frequency characteristics of this model is shown in Figure 7.25 (line RLS). 

Thus one tries structure S3 which introduces a model for the disturbance 
(ARMAX model). The output error with extended prediction model is used 
(OEEPM) with a decreasing adaptation gain (A1). The results of identification and 
validation are given below: 
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S=3 M=3 (OEEPM) A=1 FILE:POULBO1I.C NS=254 DELAY D=2 
COEFFICIENTS OF POLYNOMIAL A: A(1)= -1.60955 


COEFFICIENTS OF POLYNOMIAL B:  B(1)= 0.30530 


COEFFICIENTS OF POLYNOMIAL C: C(1) = -0.67530 


VALIDATION TEST: Whiteness of the residual error 


Validation Criterion: Theor. Val.: |RN(i)| < 0.136, Pract. Val.: |RN(@)| < 0.15 


A(2)= 1.87644 
A(3) = -1.49879 
A(4) = 0.88574 


B(2) = 0.39430 


C(2) = 0.2283 
C(3) = -0.0653 
C(4) = -0.0585 


System variance: 0.1061 Model variance: 0.1055 


Error variance R(0): 0.0004 
NORMALIZED AUTOCORRELATION FUNCTIONS 


RN(O) = 1.0000 RN(1) = -0.0425 
RN(2) = 0.0959 RN(3)= -0.0563 
RN(4) = -0.0407 


The validation is really satisfactory, as all the values RN(i) are smaller than 0.136 
for i = 1,2,3,4. The frequency characteristics of this model is shown in Figure 7.24 
(line OEEPM). The comparison of the frequency characteristics of the models 
identified shows that a good validation corresponds to the identification of a less 
damped second resonant mode. 


7.6 Concluding Remarks 


This chapter has shown how effectively an identification of a plant model has to be 
carried out. The different steps can be summarized as follows: 


Input/output data acquisition using a PRBS (pseudo-random-binary 
sequence) as input 

Conditioning of the acquired data (DC removing, data scaling, filtering); 
selection or initial estimation of the system order n = max (n4, ng +d) 
Selection or estimation of n4, ng, d either by order estimation techniques, 
or by inspection of the numerical values of the estimated parameters 
Identification and validation using several structures plant + disturbance 
and identification methods with the objective of obtaining the best 
acceptable model with lowest n į and np 

Analysis of the model identified and validated both in the frequency and 
time domain 
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Practical Aspects of Digital Control 


Digital controller design methods and system identification techniques provide the 
basic tools for effectively solving a control problem. The final stages in the 
controller design are emphasized in this chapter. This involves implementation 
aspects, performance specifications and the interaction between plant 
identification and controller design. 

The first part of the chapter reviews several topics related to the 
implementation of digital controllers: effect of the digital-to-analog conversion, 
effect of saturations, effect of the computational delay, manual to automatic 
switching, cascade control, performance evaluation, adaptation of controller 
parameters, the hardware for controllers implementation. 

In the second part of the chapter, the joint use of system identification and 
controller design is illustrated through several examples: 


Temperature control of an air heater 

Speed control of a DC motor 

Cascade position control of a DC motor 

Position control through a flexible transmission 

Position control of a 360° flexible robot arm 

Deposited zinc control in hot-dip galvanizing (SOLLAC-Florange) 


8.1 Implementation of Digital Controllers 


8.1.1 Choice of the Desired Performances 


The choice of desired performance, in terms of response time, is linked to the 
dynamics of the open loop system and to the power availability of the actuator 
during the transient. One should also take into account some “robustness” aspects. 

Indeed, the acceleration of the natural response of a plant requires control 
“peaks” during transients that are greater than the steady state values. 
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If, for example, a system has the transfer function //(/+sT) and it is desired to 
accelerate the closed loop system response twice, i.e. to obtain a transfer function 
1/(1+sT/2), it is necessary to apply, for a certain time during the transient interval, 
a maximum input level which is twice the steady state value (i.e. umax = 2 Ustat 


(Ustat = Value of control signal during the steady state). 


Here the control is reduced 


Figure 8.1. Acceleration of the natural response of a system 


This is shown in Figure 8.1. By applying 2u,,,,, we expect to have the value 2y 


sta? 
at the end of the system natural time response, but the value y is approximately 
obtained after a period that is equal to half of the time response. The controller 


should then reduce the control signal to u,,,, to get the desired steady state value y. 


The following relation can thus be considered: 


u _ desired speed _ desired pass band 


natural speed ~ natural pass band 


It follows that the closed loop performances will depend on the actuator power 
availability. Or, vice versa, it will be necessary to choose the actuator according to 
the desired performances and the open loop response of the system. 

With regard to the structure of the performance models for tracking CHCE )) 


and for regulation (P(q~/)), second-order models are preferred over first-order 
models for the same time response. This choice is a consequence of the fact that for 
a given time response the transient stress on the actuator will be weaker for a 
second-order model (as a result of a smoother response slope at the beginning of 
the transient). 

It has been shown, in Chapter 2, Section 2.6 that the robustness of the closed 
loop system, with respect to uncertainties or variations of plant parameters, 
depends upon the ratio between the band pass (related to the rise time) of the 
regulation dynamics (mainly defined by P(q~/)), and the band pass (related to the 
rise time) of the plant in open loop (mainly defined by A(q~/)). The robustness of 
the closed loop systems is better as this ratio is approaching 1 (assuming that the 
open loop is stable). 
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In the situations where the desired dynamics in closed loop is significantly 
faster than the plant dynamics, a more careful design is necessary in order to assure 
the robustness margins. In such cases one should 


1. Optimize the choice of the closed loop poles and of the fixed parts of the 
controller S(q-/) and R(q~), in order to obtain the best possible robustness 
margins 

2. Improve the quality of the plant model and reduce the uncertainties by: 


e Better identification in order to obtain a model which is relevant for the 
band pass desired in closed loop 

e Reduction of the size of the operating regions where only one 
controller is used 

e Use of “adaptive control” techniques 


Note that the techniques for identification in closed loop described in Chapter 9 
allow, in general, improvement of the quality of the models for the design of high 
performance controllers. 

The achievable tracking dynamics is mainly limited by the power and the band 
pass of the actuators. 

If the dynamics of the actuator is much faster than that of the plant, there is a 
risk that the high frequency dynamics of the plant be excited. It is therefore 
necessary, in these cases, on one hand to have a plant model which is relevant in 
the high frequencies and, on the other hand, to design a controller leading to an 
input sensitivity function with a low magnitude at high frequencies. 


8.1.2 Effect of the Computational Time Delay 


Two situations can be distinguished: 


1. Computation time equal to or greater than 0.5 T,. 


In this case, the values measured at instant ż are used to compute the 
control u that will be sent at instant t+ 7. The computer thus introduces an 
additional time delay of | and the new delay to be considered for the design 
of the controller will be 


d'=d+1 


This is illustrated in Figure 8.2a. 


2. Computation time less than 0.5 T, 


In this case, the control is sent at the end of the computation. This is 
illustrated in Figure 8.2b. The computer introduces a fractional time delay 
which has the effect either of introducing a zero, or of modifying the 
existing zeros in the pulse transfer function of the plant. This effect is 
negligible if the computation time is much smaller than the sampling 
period. 
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Figure 8.2a,b. Synchronization procedure for the measurement and the computed control: a 
computation time greater than 0.5 T, ; b computation time less than 0.5 T, 


8.1.3 Effect of the Digital-to-analog Conversion 


The control signal generated by the digital controller is often computed with 
floating (or fixed) point arithmetic on 16, 32 or 64 bits. So the distinct values of 
this signal are larger than the distinct values of a digital to analog (D/A) converter 
which in general does not have more than 12 bits (4096 distinct values). 

Figure 8.3 shows the characteristic of a digital to analog converter. The 
computed values of the control signal (u) are represented on the horizontal axis and 
the rounded values (u,), effectively obtained at the output of the D/A converter, are 
represented on the vertical axis. Q represents the quantization step. 

In a digital controller, the control signal generated at instant t depends upon the 
previous values of the control signal effectively applied on the plant input. It is 
therefore necessary to round the control u(t) inside the digital controller in order to 
correctly compute the future values. 

The equation defining the controller has the form 


S(q u(t) + RADYO =T(q"')y (+d +1) (8.1.1) 
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U real 
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Figure 8.3. The characteristic of a digital to analog converter 


and respectively 


u(t) => T(q')y (t+d +1) -Sq ut -1) -RUIVA (8.1.2) 
al 0) 


(where sọ = / in the case of pole placement). 
In order to take into account the effect of the D/A converter, the expression of 
the control u(t ) becomes 


u(t) = fra” ytd +1) -S* (qu, (t=) - RY) (8.1.3a) 
0 


where u,(t) is the rounded control signal sent to the D/A converter and satisfying 
|u,.(t) -u(t)|< 1/20 (8.1.3b) 


If this rounding operation is not implemented, an equivalent noise is introduced at 
the plant input. This produces, in general, an increase of the variance of the plant 
output. In some cases low magnitude oscillations can be observed on the plant 
output. 


8.1.4 Effect of the Saturation: Anti Windup Device 


The effect of the saturation on the actuator can deteriorate the performance, in 
particular if the controller includes an integrator. Therefore, the effect of the 
actuator saturation has to be taken into account since for the computation of u(t) 
the previous values of the control must be considered. The previous computed 
values are replaced by the applied values. This is equivalent to the introduction of 
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a “copy” of the nonlinear actuator characteristic in the controller. As a 
consequence, the control law becomes 


T(q "jy (t+d+1)-R(q" y(t)-S (q a(t-V) (8.1.4) 
So 


u(t) = 


In Equation 8.1.4, u (t-/) is the vector of previous values of u(f) passed through 
the nonlinear characteristic (saturation). 
This is shown in Figure 8.4 for the control law 


_ Tq" )y t+) -nyA -s Tt- 
So 


u(t) (8.1.5a) 


u(t) if lu(t)| < Usa 
Ult)=<5 Uat If U(t) Ua (8.1.5b) 


TU sat if u(t) <-u sat 


corresponding to tracking and regulation with independent objectives for a discrete 
time model described by 


y(t +1) =a, y(t) + bju(t) + bzu(t —1) (8.1.6) 


Figure 8.4. Digital control in the presence of actuator saturation (anti windup device) 


The effects of the saturation of the control input and of the anti windup device 
are illustrated in Figure 8.5 for the case of a position control of a DC motor 
(described in Section 8.4). Both the plant and the controller contain an integrator. 

One can observe that the saturation of the control slowdowns the system 
response and produces a significant overshoot, with respect to the case without 
saturation. The introduction of an anti windup device allows one to obtain a 
response without overshoot but which is obviously slower than the response in the 
linear operation case. 
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One can ask, looking at the evolution of the control signal, if it is possible to 
accelerate the system response in the presence of saturation, by maintaining the 
control at the saturation level for a longer duration, but still assuring a system 
response without or with a small overshoot. 


Anti Saturation: Step Responses 
na k irar keg ey erai TON 


Amplitude (Volt) 


Time (s), T; =0.12s 


Anti Saturation: Control Signal 
eta 


Amplitude (Volt) 


Figure 8.5. Response (in simulation) of a digital position control in the presence of 
saturation 


In order to achieve this, it is necessary to impose dynamics on the trajectory of 
u(t) when it leaves the saturation level (instead of a simple gain). Such a scheme is 
represented in Figure 8.6, where the dynamics of u(t) when it leaves the saturation 
level is defined by the polynomial 


Ps(q')=1+q'P5(q') (8.1.7) 


Ty *- Ry (t) 


Figure 8.6. Anti windup device with specified dynamics when u(t) leaves the saturation 
level 
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In the linear domain (|u(4)| < | usat | -> u (t) = u(d), this system has the transfer 
function 1/S(q~/). Effectively from Figure 8.6 one gets 


1 
SoP, (q) n 1 _ (8 1 8) 
-Í = -i -1 -1 -1 D 
pS JSP ) SoPC +S )-soPsla ) Sa) 
SoP, (q"') 
The controller equation in the general case will take the form 
SP (qu =T y +d +- RG”) 625) 
-ad-san a0 
and u(t) will be given by 
u(t) = (sy (+d +D -RGDA EA 
[s-s aD] TO -sP Gute -D} 
but 
Sq) -sPA =s ta S a otas] gi ay 
= g's ah -sP a 
One gets therefore the following equation for the control signal: 
u(t) = Asy C+ d +) = RIO ais 


- [sad -=soP; (Cm) u(t -1)—SoP, (qult -»} 
where 


u(t) if |u(t)| tsa 
TO= iua if UZU (8.1.12b) 


U sat if u(t) s U sat 


The next question is how to choose the dynamics for the evolution of u(t) when it 
leaves the saturation level. One generally chooses 


Ps(q?)=14 ps q ; -08<ps <0 (8.1.13) 
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This choice for ps is easier to interpret if one considers Equation 8.1.13 as the 


denominator of a first-order discrete time filter resulting from the discretization of 
a first-order continuous time filter characterized by a time constant 


Tsat (Ps =g Ta ). In this case the choices indicated in Equation 8.1.13 
become 

0 < L ae s 4T, 
(T,,, =4T, corresponds to p, =—0.778). 


Figure 8.7 illustrate the accelerating effect of this dynamics in the presence of 
saturation. One observes that for7,,, = 2T, ( pı = -0.602 ) one gets an acceleration 


with respect to the case T a, =0 and still without overshoot. 


Note that the value to be selected for ps (T, 


at)» Within the indicated bounds, is 


related to the specificity of each application. 


Anti Saturation with a Specified Dynamics: Step Responses 
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Figure 8.7. Digital position control (in simulation) with anti-wind-up device and dynamics 
when u(t) leaves the saturation level 
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8.1.5 Bumpless Transfer from Open Loop to Closed Loop Operation 


To avoid large transients when one moves from the open loop operation to the 
closed loop operation, it is necessary to initialize the « memory » of the controller 
(i.e. to provide y(t-/), y(t-2) ..., u(t-1), u(t-2), ...r(t-1), ...). 

A method for controller initialization (when it is still in open loop operation) is 
described next: 


1. One replaces the reference and the desired output by the measured output 
value (y*(t+d+J) = y(t); r() = (0). 

2. One stores the control u(t), applied in open loop operation, in the controller 
memory. 

3. One repeats step 1 and 2, for a number of times equal to n = max (n4 + ns, 


d+ ng + np). 
4. One switches from open loop to closed loop operation. 
Using this procedure, the control signal will have, at the switching instant, the 
value of the control signal applied at the previous instant in open loop operation. 
To see this, suppose that y(t) = constant during the initialization phase and that 
the controller has an integrator. The control signal at the switching instant will be 
given by 


u(t) = (1/59 |) y(t)— R()y(t) = S* (u(t -1)| (8.1.14) 


(since y*(t+d+/) has been replaced by y(#)). 
The controller has an integrator so S(/) = 0 and S*(I) = -sọ, because 


S(q7') = so +q 'S* (q). Furthermore, 7(/) = R(/) (since one has a unit gain 
between y“ and y). One gets then from Equation 8.1.14: 


u(t)=u(t-1) ; t=max(ny+ng;d+npg +np) (8.1.15) 


A C** code for a RST digital controller which takes in account the D/A effect, 
the anti windup device and the bumpless transfer protocol can be downloaded from 
the book website’. 


8.1.6 Digital Cascade Control 


Cascade control has been used in industry for many years. Its origin is probably 
the observation that between the actuator and the main controlled variable, there 
are intermediate physical variables that is interesting to control for various reasons. 
The block diagram of a cascade control is shown in Figure 8.8. 


' http//: landau-bookic.lag.ensieg.inpg.fr 
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Plant 


Figure 8.8. Block diagram of a cascade control 


The controller for the main variable (n) provides the desired value for the 
intermediate variable (n-/). The controller for the intermediate variable (k) will 
provide the desired value for the variable (k-17). With cascade control, bounds on 
the intermediate variable (k-/) can be easily achieved by limiting the output of the 
(k) controller which provides the reference for the loop (k-12). 

The logical order of the variables in a cascade control scheme results from the 
physical structure of the system. For example in a positioning system using a DC 
motor, the position will depend upon the speed, which in turn depends on the 
current which will be driven by the voltage applied to the motor. The physical 
constraints require that, during position transients (in tracking or regulation), the 
maximum rotational speed and the maximum current be bounded. These bounds 
will be obtained easily by bounding the output of the position controller and of the 
speed controller, respectively. 

A similar situation is encountered in the level control of a liquid in a tank. The 
level of the liquid will depend upon the flow rate of the incoming liquid, which, 
itself, will depend upon the valve position. 

Another important aspect in cascade control is related to the dynamics of the 
intermediate variables. These dynamics become more and more rapid as we 
approach the actuator. This allows decomposition of the transfer function from the 
control signal to the main output variable in several blocks, each being 
characterized by a different time scale. 

This is particularly important in the case of digital control where the selection 
of the sampling frequency will depend for each loop upon the dynamics associated 
to the intermediate variable. It is this aspect that makes the difference between a 
continuous time cascade control and a digital cascade control. 

In practice, we will start by selecting the sampling frequency for the first 
control loop characterized by the fastest dynamics. The sampling frequency for the 
other loops should be an integer under multiple of the sampling frequency for the 
first loop. In addition the sampling frequency for the loop (A) should be either an 
integer under multiple of the sampling frequency of the (k-71) loop or equal to it”. 

The implementation of a cascade control first requires one to identify the 
transfer function between the input to the actuator and the first intermediate 
variable followed by the design of the RST controller for this loop. Once the first 


? This sampling frequency selection concerns the frequency at which the controller operates. This has 
not to be confounded with the data acquisition frequency that can be the same for all the loops. 
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loop is implemented, one has to identify the model corresponding to the first closed 
loop cascaded with the part of the plant connecting the intermediate variables | and 
2. The excitation sequence is superposed to the reference input of the RST 
controller for the first loop and the output is the intermediate variable 2 (see 
Section 8.4 for an example). The controller for the loop 2 will be designed on the 
basis of this model and the control specifications. One then repeats the procedure 
for the other loops. 


8.1.7 Hardware for Controller Implementation 


There is a variety of hardware options for implementing a digital control scheme. 

For a rapid test prior to final implementation on a specific hardware, one can 
use a “software in the loop” systems which include real time kernels (like Vissim 
(Visual solutions) or Simulink (Mathworks). Dedicated RST real time schemes 
operating on a PC can also be used (like Wintrac (Adaptech), which also provides 
the C™* code to be compiled and downloaded on the controller). 

For the effective implementation on a micro-controller, a C++ code (Adaptech), 
available from the book website’, can be used as a reference. 

Many applications use a PC in which several controllers are implemented 
together with the logic related to the operation of a specific plant. 

Another option is provided by the DCS (digital control systems). They have a 
high level programming language allowing to code the RST controller. See, for 
example, Roland and Landau (1991). 

The PLC (programmable logic controller) is probably the device on which RST 
controllers are mostly implemented. The PLC produced by various manufacturers 
(see Figure 8.9) incorporate the function “RST controller” (like LTI 160 (Leroy), 
Alspa (Alstom), Quantum (Schneider Modicon)). A guide for the integration of 
RST controllers on a programmable system is available (Adaptech 2001a)*. 

A number of programmable controllers (like T640 (Eurotherm), u- pilot 


(Soléa)) also allow the implementation of RST controllers. 

The micro-controller boards, the VME boards under real time operating system 
OS9 and DSP boards also allow one to implement RST digital controllers 
operating at high sampling frequency. 

To summarize: any digital computer with a data acquisition system and a real 
operating system can be used for the implementation of a digital control. 


8.1.8 Measuring the Quality of a Control Loop 


An important aspect of controller design and implementation is the measure of the 
achieved performance. This is easy, in general, for the tracking aspects (some step 
changes may be enough) but less obvious for the regulation aspects since, in 
practice, one cannot apply the disturbances. Evaluating the regulation performance 
for continuous type production processes is extremely important since any 


3 http:/Nandau-bookic.lag.ensieg.inpg. fr 
4 To be downloaded from the website: hitp://www.adaptech.com 
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improvement in the regulation performance has an economic impact (improvement 
of the product quality, reduction of raw materials and energy consumption, 
reduction of machine stress). 

For continuous time production processes, evaluation of the regulation 
performance is done using histograms of the measurements of the controlled 
variable over a certain time horizon (the horizon should be long enough in order 
that the results have a statistical meaning). 

Figure 8.10 illustrates the histogram of a controlled variable for a “poor” 
control and for a “good” control. 

If the control performance is “poor”, one observes that a significant number of 
measurements are far from the average value (corresponding to the reference 
value). This will require to move the reference value towards higher values in order 
to guarantee a minimum acceptable value for the controlled variable (for example: 
minimum depth coating on a steel strip, minimum humidity in drying processes, 
etc.). 


Figure 8.9. PLC Leroy LT160 embedding several RST controllers and I/O modules 
(courtesy of Leroy Automatisme) 


If one has a “good” control, the dispersion of the measurements around the 
mean value will be significantly reduced. This corresponds to the reduction of the 
variance of the controlled variable (and of the standard deviation). As a 
consequence, on one hand a better quality (uniformity) of the products will be 
obtained and, on the other hand, the set point can be moved close to the tolerance 
limits. This in general will induce raw material and energy savings. 

From a histogram one makes the following computations: 


e Mean value: 


N 


1 
YM = v2 


If the controller has an integrator, the mean value is often very close to the 
reference value (assuming that the disturbances over the measurement 
horizon have an almost zero mean value — this is often the case in 
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continuous time production processes if the measurement horizon is 


enough large). 
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Figure 8.10. Histograms of the controlled variable 


e Standard deviation: 


1/2 
o =| EE00-r4 P} 


i=l 


If the histogram has a form close to that of a Gauss bell (Gaussian 
distribution - see Appendix A), 63% of the measurements will be in the 
interval + o around the mean value and more than 95% of the 


measurements will be in the interval 4 


t 2 o around the mean value. In 


addition, from the histogram one can directly determine the percentage of 
measurements which are inside a certain tolerance zone. 
It is important to mention that for high capacity production processes an 
improvement of the regulation performance (i.e. the reduction of the standard 
deviation) of 1%, or less, may have an important economic impact. This impact 


may be significantly higher than the inves 


tment for improving the control 


performance (in many cases a plant model identification and replacement of a PID 
controller by a digital RST controller designed on the basis of the identified model 


may achieve this). 
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8.1.9 Adaptive Control 


“Adaptive Control” is a set of techniques used for on-line automatic tuning of 
controllers in order to achieve (or to maintain) a certain level of performance when 


e The plant parameters are unknown or vary during plant operation 
e The plant parameters are known but the characteristics of the disturbances 
are unknown or vary during operation 


Adaptive control techniques should be considered only when the large variability 
of the plant parameters, or of the disturbance characteristics, does not allow to 
design a robust linear controller assuring satisfactory performance. We distinguish 
two categories: 


1. “Closed loop” adaptive control 
2. “Open loop” adaptive control 


A “closed loop” adaptive control combines in general a real time (recursive) 
identification algorithm with the computation in real time of the controller 
parameters based on the current values of the estimated model parameters and of 
the desired performance. The tuning of the controller can be done at each sampling 
instant or at a lower frequency. In this second case one has a time horizon for the 
estimation of the plant model followed by the computation of the new controller 
parameters. 

If this estimation horizon is significantly larger than the number of parameters 
to be estimated and, in addition, an external excitation is added during the 
parameter estimation stage (the controller being constant over this horizon), one 
has an iterative scheme which combines plant model identification in closed loop? 
with the redesign of the controller. 

A “closed loop” adaptive control system should incorporate a supervision 
function, which monitors the correct operation conditions for the adaptive loop (ex: 
richness of the excitation signal used for identification, compatibility of the 
identified model with the control design, etc.). A block diagram of a “closed loop 
adaptive” system is shown in Figure 8.1 1a. It includes a control loop, an adaptation 
loop, and a supervision device. Closed loop adaptive control schemes, featuring 
explicitly a real time model estimation block followed by a real time controller 
design block, are termed “indirect adaptive control”. 

In a number of cases, one can directly tune (estimate) the controller parameters 
without an explicit use of the current model parameters for controller redesign. 
This type of scheme, shown in Figure 8.11b, is termed “direct adaptive control” 
(examples: model reference adaptive control, adaptive tracking and regulation, 
adaptive minimum variance control, adaptive rejection of unknown disturbances). 


> The techniques for plant model identification in closed loop operation are presented in Chapter 9. 
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Figure 8.11a,b. Closed loop adaptive control: a indirect adaptive control; b direct adaptive 
control 


Closed loop adaptive control schemes have basically two modes of operation: 
self-tuning operation and adaptive operation. In the self-tuning operation, the 
adaptation starts when a degradation of the performance is detected and stops when 
the desired performance is achieved. In the adaptive operation the algorithm 
operates all the time. 

The characteristics of a plant dynamic model often depend upon a set of 
measurable variables which define an operating point (for example in hot dip 
galvanizing, the dynamic characteristics of the process depend upon the steel strip 
speed and the position of the air knives with respect to the steel strip — see Section 
8.7 for details). In such cases one can use an “open loop” adaptive control scheme, 
as shown in Figure 8.12. 

The range of operating points is divided in a number of operation regions. For 
each region, a relevant operating point is selected and a corresponding controller is 
designed based on an identified model. This controller assures the desired 
performances for all the operating points located within this region. The 
corresponding controllers are stored in a table. When the plant will operate in one 
of the operation regions, the corresponding values of the controller parameters will 
be used according to the table. 
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Figure 8.12. Open loop adaptive control scheme 


For many applications characterized by a large variability of the plant 
dynamics, resulting from the change of the operating point, an “open loop” 
adaptive control is enough for assuring the desired performance over the range of 
possible operating points. 

It is this approach which is illustrated in Section 8.6 (hot-dip galvanizing at 
SOLLAC-Florange). 

For a detailed presentation of adaptive control techniques see: Landau (1979), 
Landau (1986), Åström and Wittenmark (1995), Landau et al. (1997), Landau 
(1993) and Landau et al (2005). 


8.2 Digital Control of an Air Heater‘ 


This section aims at illustrating the implementation on a real system (air heater) of 
an RST digital controller, designed according to one of the methods presented in 
Chapter 3 and based on an identified discrete-time model of the plant (for details 
concerning the identification of the air heater see Chapter 7, Section 7.5.1). 

The diagram of the system and of the digital control loop is represented in 
Figure 8.13. The air is heated by means of a resistor supplied by a computer 
controlled thyristor power amplifier. The controlled variable is the air temperature 
at the output which is measured by a thermocouple. 

Two models have been identified and validated for this air heater with T =5s 


(see Chapter 7, Section 7.5.1): 


é The examples presented in this chapter have been worked out with WinPim (Adaptech) identification 
software and WinReg (Adaptech) control design software. Small numerical differences will result when 
using other identification and control design routines. 
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0,1724q7! + 0,0579q ° 


Model1: (OEEPM) 
1-0,6589q7! 
-l -2 
Model2; *Tg +0043  (OEFC) 
1— 0,68374 


The pole placement method has been used for the controller design”. The same 
dynamics for the tracking and regulation desired performances will be chosen. The 
rise time for the two models is about 6 T, (~ 30s) (see Figure 7.11). First we will 
consider for the closed loop response an acceleration of /.25 times with respect to 
the open loop response (desired rise time ~ 24s) with almost no overshoot. In 
order to obtain a rise time of about 24s in closed loop, it is found , from diagrams 
of Figure 1.10 (or 1.11b), that for a second-order with damping ¢ = 0.9, it is 
necessary to set @) = 0.136 rad/s. The desired closed loop poles will result from 


the discretization of a second order continuous time system with @) = 0.136 rad/s 
and ¢ = 0.9 (the response has almost no overshoot) for T, = 5s. 


f tf 


temperature 
measurement 


micro- 
computer 


power | 


amplifier 


Figure 8.13. Digital control of an air heater 


Table 8.1 summarizes the results of the digital controller design based on the 
model | and using the pole placement. Figure 8.14 shows the magnitude of the 
frequency response of the output sensitivity function Syp Note that the resulting 
curve respects the robustness template. 

The designed controller has been tested first in simulation, both on model | and 
model 2. Figure 8.15 illustrates the closed loop response with both models 


7 Tn this case one can also use the tracking and regulation with independent objectives, as the zeros of 
the plant model are stable (b3 < b7). 
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(simulation). The rise time is about five sampling periods (~ 25s) matching the 
desired performance. The differences between the responses obtained with the two 
models are negligible (one can note a difference in the input signal applied to the 
system, caused by the different identified static gains). 


Table 8.1. Controller designed by “pole-placement” for the air heater, with o = 0.136 rad/s, 
and € = 0.9 (both tracking and regulation) 


Plant: 


e d=0 
© = B(q') = 0.1724 q” +0.0579 q° 
e = A(q') = 1 -0.6589 q° 


Tracking dynamics > T, = 5s, @g = 0.136 rad/s, €= 0.9 


© B,, (q') = 0.1543 +0.1024 g1 
e Am (q') =- 1.0372 ¢'+0.2940 q” 


Regulation dynamics > T, =5s, ag = 0.136, C= 0.9 
P(g’) = 1 -1.0372 q” +0.2940 q° 
Pre-specifications: Integrator 


* CONTROL LAW *** 
Sq!) ut) + RG) yO = Mg). y*(t+d41 
(Ti) ul) + RQ“) VO = Tq"). y (t+d+1) 


y (t+d+]) = Bug!) / Ama D). rÀ 
Controller: 


© R(T!) = 2.7637 - 1.6491 q! 

© S(t) = 1-0.8549 q1 - 0.1451 q? 

© Tq!) = 4.34- 4.5017 ¢! + 1.2762 q? 
Gain Margin: 5.61 Phase margin: 63.6 deg 
Modulus margin: 0.732 (- 2.71 dB) Delay margin: 9.6 s 
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Figure 8.14. Output sensitivity function with the controller based on the specifications 
= 0.136 rad/s, and € = 0.9 
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Figure 8.15. Simulated closed loop response for the air heater (model 1 and model 2) with 
the controller based on model 1 and the desired performances: wg = 0.136 rad/s and C=0.9 
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Air Heater: Output 
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Figure 8.16. Real time responses for the controller designed from the specifications 
©p=0.136 rad/s, € = 0.9 


The experimental results for temperature variations around 60°C (3.2V) are 
given in Figure 8.16. One can see that the rise time is indeed about 25s. 

We now consider the case in which a stronger acceleration is required for the 
closed loop system if compared to the natural system response (open loop 
response). For a rise time about 75s (rise time reduced to half of open loop rise 
time), it results, from the diagrams of Figure 1.11, that the desired dynamics for the 
closed loop corresponds to that of a second-order system characterized by @ = 


0.226 rad/s; ¢ = 0.9. The new controller must guarantee, nevertheless, a modulus 


margin greater or equal to 0.5 and a delay margin at least equal to 5s (/ Ts). 

On the basis of these new specifications, the results of the controller design are 
given in Table 8.2. Note that the robustness margins are reduced with respect to the 
margins found in the previous case, as a consequence of the stronger acceleration 
required (rise time reduction). The delay margin obtained, in particular, is very 
close to the limits (7,=5s). However the robustness conditions for the modulus and 


the delay margins are still satisfied. 

The magnitude of the output sensitivity function is presented in Figure 8.17. 
We observe that the sensitivity function reaches the upper template. The system 
response cannot be further accelerated while preserving the robustness (without 
specific calibration of the sensitivity functions). 
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Table 8.2. Controller designed by “pole-placement” for the air heater, with œg = 0.226 rad/s 
and € = 0.9 


Plant: 


e d=0 
© Bq!) = 0.1724 q” +0.0579 q? 
© A(q') = 1 -0.6589 q? 


Tracking dynamics > T, = 5s, ag = 0.226, = 0.9 


© Bm (q!) = 0.3281 +0.1652 q1 
e Am qD = 1 - 0.6373 q1 +0.1308 q? 
Regulation dynamics > P (q) = ] -0.637 q! +0.1308 q? 
T, = 5s, 09 = 0.226, ¢= 0.9 
Pre-specifications: Integrator 


*** CONTOL LAW *** 
Sq) ut) + RG) xO = Ma) y*t+d+1) 


y'(ttdt+) = (Bog!) Ama) -rO 
Controller: 
© Rg!) = 4.6461 -2.5045 q1 + 0.1147 q? 
© S(t) =1- 0.7797 q1 -0.2202 q? 
e Tg} = 4.34 -2.7662 q1 + 0.5677 q2 


Gain Margin: 3.159 Phase margin: 51.9 deg 
Modulus margin: 0.613 (- 4.25 dB) Delay margin: 5.05 s 


The simulated responses for both models of the air heater are presented in 
Figure 8.18. The responses obtained in simulation with the two models are again 
very close. The only difference one can see is the steady state value of the input 
signal (as the model gain is different). The rise time is about 15s. One can note an 
increase of the actuator effort needed during the transient as the rise time has been 
reduced (to be compared with Figure 8.15). 

The experimental results obtained for temperature variations around 60°C 
(3.2V) are given in Figure 8.19. The controller designed with the specifications 
@p=0.226 rad/s and ¢ = 0.9 allows one to obtain the desired performances (rise 
time ~ /5s, no overshoot). 

Figure 8.20 shows the behavior during regulation (around 65°C) for a 
disturbance introduced by a step variation of the fan speed (see Figure 8.13). 
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Figure 8.17. Output sensitivity functions for the controllers designed from the specifications 


p= 0.226 rad/s, 6 = 0.9 and œ= 0.136 rad/s, ¢ = 0.9 respectively 
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Figure 8.18. Simulated closed loop response for the air heater (model 1 and model 2) for 


the controller designed from œ= 0.226 rad/s, € = 0.9 
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Figure 8.19. Real time response for 


specifications: ®g=0.226 rad/s and ¢ 
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Figure 8.20. Air heater output in regulation with the controller based on the specifications: 
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8.3 DC Motor Speed Control 


The block diagram of the DC motor digital speed control is shown in Figure 8.21. 
For controller design, the model of the motor previously identified (see Chapter 7, 
Section 7.5.3) has been used. The specific real time implementation has been done 
using Wintrac (Adaptech 2004). 


DC ji i 
O oer | 
1/0 amplifier 


tachometer 


Figure 8.21. Digital speed control of a DC motor 


The model identified with OEEPM (7, = /5 ms) has been used (see Chapter 7, 
Section 7.5.3). 


0.2617q7! +0.2288q~° 


Motor model: i 
1-0.535q7 


The model has a stable zero since b? < b;, but very close to the unit circle. It is 
therefore not recommended to use the tracking and regulation with independent 
objectives. The pole placement method will be used. The model rise time is around 
4.5 T; (~ 67 ms) (see Figure 7.19). An acceleration by a factor of 1.33 is desired 
for the closed loop time response (desired rise time: ~50 ms) together with a small 
overshoot. In order to obtain a rise time tr ~ 50 ms, from Figure 1.10 it results that 
a second-order continuous time system with ¢ = 0.9 0, @ = 75 rad/s has to be 
chosen as desired closed loop dynamics. Therefore the desired closed loop poles 
will result from the discretization of a second-order continuous time system with 
@ =75 rad/s, € = 0.9 and T, = 15 ms. The same dynamics have been chosen for 
tracking. 

Table 8.3 summarizes the controller design for the identified model of the 
motor. The robustness margins are satisfactory. Figure 8.22 illustrates the 
simulation results using the identified model both in tracking and regulation. The 
rising time is~55 ms. This is normal, since in pole placement there is the 
additional dynamics of B(q~/) which will influence the results. In this case it is a 
fractional delay of about ~5 ms. 
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Table 8.3. “Pole placement” speed controller with m9 = 75 rad/s and ¢ = 0.9 (DC motor) 


Plant: 
e d=0 
© Big?!) = 0.2617 g1 + 0.2288 q2 
© Ag!) =1-0.5351 gq! 


Tracking dynamics > T, = 0.0158, ag = 75 rad/s, C= 0.9 


© By = 0.3262 +0.1647 q1 
© A, =1-0.6409 g! +0.1319 q? 


Regulation dynamics > P = 1-0.6409 q1 +0.1319 q? 
T,= 0.015s, a9 = 75, ¢= 0.9 


Pre-specifications: Integrator 


*** CONTROL LAW *** 
Sq’) . u(t) + Rq 1 nq) y (t+d+1 
(q). ut) + RA). vO TG) y (t ) 


y"(tdt]) = (By (G2) Am D) -rA 
Controller: 
© R(g4) = 1.9176 - 0.9168 q7 
e Sig!) =1- 0.6078 g!-0.3921 q2 
© Tq!) = 2.0382 - 1.3065 ¢!-0.269 q? 


Gain margin: 3.205 Phase margin: 57.8 deg 
Modulus margin: 0.625 (- 4.08 dB) Delay margin: 22 ms (1.46 T;) 


Real time results are shown in Figures 8.23 and 8.24. Figure 8.23 shows the time 
response of the motor speed for a step change in the desired speed. The rising time 
is close to the simulated one (~ 55 ms). Figure 8.24 illustrates the behavior of the 
closed loop system for a load disturbance. It is an almost step disturbance followed 
by an almost instantaneous take off of the load at 393 T,. The disturbance rejection 


time is ~ 105 ms. 
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Figure 8.22. Simulation results for the digital speed control with œọ = 75 rad/s and € = 0.9 
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Figure 8.23. Closed loop speed response of a DC motor for a step on the reference 
(tracking dynamics œo = 75 rad/s, 6 = 0.9 ) 
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DC Motor: Output 
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Figure 8.24. Motor speed response for a load disturbance (regulation dynamics: ag = 75 
rad/s, & = 0.9) 


8.4 Cascade Position Control of a DC Motor Axis 


The block diagram of the cascade position control of a DC motor axis is shown in 
Figure 8.25. 


DC motor + inertia 


I 
2 RST Power |o 
Position amplifier 


Speed loop '------------}---------- 


Position loop 


Figure 8.25. Digital cascade control position of a DC motor axis (the D/A and A/D 
converters are not shown) 


In this specific application the DC motor already considered in Section 8.3 (speed 
control) will be used. We will discuss now the integration of the speed control loop 
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in a cascade position control. The implementation of this cascade control scheme 
in real time has been done with a PC using WinTRAC (Adaptech 2004)*. 

The sampling period for the speed loop is /5 ms (see Section 8.3). Since the 
dynamics of the position is significantly slower (presence of an integrator and of an 
important mechanical mass), a longer sampling time has to be used in the position 
control loop. A sampling time of /20 ms has been chosen (it is a multiple of /5 
ms). In order to design the position controller it is necessary to identify the 
dynamic model between the reference of the speed loop and the axis position. 

The PRBS for identification has been applied to the reference input of the 
controller. The characteristics of the PRBS used for identification are: 


e Number of cells of the shift register: N = 7 

e Clock frequency: fprps = f,/2 (Tprgs = 240 ms) 
e Magnitude: 2V (300 rpm) 

e Length: 256 samples 


The data acquired are shown in Figure 8.26 (after centering the data). The 
integrator behavior of the system is obvious. 


DC Motor: Output 
T 


Amplitude (Volt) 


Time (s) (T = 120 ms) 
DC Motor: Signal Excitation 


T T 


Amplitude (Volt) 
o 
T 
| 


50 100 150 2 
Time (s) (T, = 120 ms) 


Figure 8.26. Input/output sequences for identification (input: speed reference; 
output: axis position) 


8 A PLC can also be used for the implementation of digital cascade control. 
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Data Pre-Processing 

Since it is known that the dynamic model contains an integrator (position is the 
integral of the speed) and taking into account the indications given in Chapter 7, 
Section 7.2.2, a model without integrator will be identified. In order to do that, a 
new input/output data set is considered: the input sequence is unchanged, whilst a 
new output sequence representing the variations of the output between the 
sampling instants ()(¢)-v(t-/)) will be used. The corresponding I/O sequences (after 
elimination of the residual DC component) are represented in Figure 8.27. 

One observes that the output level is about one fifth of the input level. 
Following the indications given in Section 7.2.3, the output should be multiplied 
by a factor of 5 in order to get a magnitude of the same order as the input. The 
resulting identified model will need to be scaled by dividing the coefficients of 
B(q‘) with a factor of 5. 


Complexity Estimation 

Using the order estimation procedure based on the use of the instrumental variable 
with delayed inputs (see Chapter 6, Section 6.5) and implemented in 
estororderiv.sci (estororderiv.m), as well as in WinPIM software (Adaptech, 
1996a), one gets for the model without integrator n = max (n4,ngtd) = 2 (see 
Figure 8.28) and ny = 1, ng = 2, d = 0, with an over estimation risk of 0.1%. 
These orders seem to be reasonable since the response time of the speed loop is 
about half of the sampling period used in the position loop, which leads to the 
presence of a fractional delay ( ng = 2). 
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Figure 8.27. Input/output file for the system without integrator 
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Figure 8.28. Order estimation from data for the model without integrator 


Parameter Identification and Validation 

The model (without integrator) identified with the recursive least squares 
(structure S1) does not pass the statistical validation tests. Selecting the structure 
S3 and the output error with extended prediction model with n4=1, ng=2, d=0 and 
nc=2 one gets a model satisfying the whiteness validation test. The results are 
summarized in Table 8.4. 


Table 8.4. Parameters of the model (without integrator) 


Model without integrator and gain multiplied by 5 
ng=1, ng=2, nc=2, d=0 
COEFFICIENTS OF POLYNOMIAL A(q ^): A(1) = 0.2154 
COEFFICIENTS OF POLYNOMIAL B(q!): B(1) = -0.1737 


B(2) = -0.5563 
COEFFICIENTS OF POLYNOMIAL C(q): C(1) = -0.3176 
C(2) = -0.1878 


TEST DE VALIDATION: Whiteness of the residual error 

Validation criterion: Theor. Value: |RN(i)| < 0.136, Pract. Value: |RNM(i)| <0.15 
RN(1) = 0.0422 RN(2) = 0.0057 
RN(3) = -0.136 RN(4) = 0.0497 


Remarks: 


1. The validation results can be improved using a variable forgetting 
factor, but the time responses of the two models are almost the same. 
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2. The gain model is negative because of the polarity of the measurement 
used. 


Inserting an integrator and dividing by 5 the coefficients of polynomial B one gets 
the model displayed in Table 8.5. 


Table 8.5. Parameters of the complete “position” model (input: speed reference; output: axis 
position) 


Position model (with integrator) 
n4g=2, np=2, d=0 
COEFFICIENTS OF POLYNOMIAL A(q7): A(/) = -0.7846 


A(2) = -0.2154 
COEFFICIENTS OF POLYNOMIAL B(q7): B(1) = -0.03476 
B(2) = -0.1112 


The polynomial B(q~/) has |b2|>|b)|, therefore the model has an unstable zero and 
the pole placement control strategy has to be used. 


Design of the Controller 
Based on the identified model, a RST controller is designed using the pole 
placement with shaping of the sensitivity functions. 

The control specifications are: 


e Dominant regulation dynamics: discretization of a second-order continuous 
time system with @ = 3 rad/s and ¢ = 0.8 (T, = 120 ms) 
An integrator in the controller 
Opening of the loop at 0.5 f, 

e Modulus margin: AM >0.5; delay margin: AT 2 T; 

e Tracking dynamics: discretization of a second-order continuous time 
system with wg = 4.5rad/s and ¢ = 0.9 


To get the integrator effect a fixed part Hs (q/) = 1 - q! must be included. For 
opening the loop at 0.5 f, a fixed part Hg(q 7) = 1 + q-/also has to be included. 

In the absence of the opening of the loop at 0.5 f, (using a filter Hp), the 
modulus of the input sensitivity function would be very large at high frequencies, 
where the system has a very small gain (it is an integrator). This leads to an 
important stress on the actuator without having any effect on the output. 

Figures 8.29 and 8.30 give the modulus of the output and input sensitivity 
functions for the following three designs: 

1. without Hp and without auxiliary poles 

2. with Hp, but without auxiliary poles 

3. with Hp and 3 auxiliary poles at 0.1 


The final controller corresponds to the third design. The auxiliary poles have been 
introduced in order to significantly reduce the stress on the actuator over 0.3 f. 


One notes a small reduction of the modulus margin with respect to the design a and 
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b, but which still has a value larger than 0.5 (|S, (¢")|\max < 6dB). The coefficients 
of the controller corresponding to the third design are given in Table 8.6. 


Table 8.6. RST controller for the position loop 


Polynomial R(q!) | Polynomial S(q/) | Polynomial 7(q'!)| Polynomial Bm(q-’) 
B m(0)=0.1057 
T(0)=-6.8479 B m(1)=0.076381 
R(0)=-1.2139 S(0)=1.0000 TOROA 
j -1 
R(1)=-0.7543 S(1)=-1.0222 T(2)=-7.0639 Polynomial 4,,(q°’) 
R(2)=0.9699 S(2)=0.2836 ee: 
A,,(0)=1.0000 
—— as T(4)=-0.1255 
A, (1)=-1.1962 
T(5)=0.0038 
A m(2)=0.3783 
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Figure 8.29. Output sensitivity function (modulus) for the various controllers 


Figure 8.31 gives the simulation results (tracking and regulation) for the 
position loop. The rise time is slightly longer than 7T, = 840 ms. 

The experimental results with the two cascaded loops (speed and position) are 
illustrated in Figure 8.32. Figure 8.32a,b gives the evolution of the position for a 
step change on the reference for the position and the evolution of the output of 
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Figure 8.30. Input sensitivity function (modulus) for various controllers 
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Figure 8.32a-d. Real time evolution of the variables in cascade position control of the DC 
motor: a position and reference for the position; b output of the position controller (speed 
reference); c speed and reference for speed; d output of the speed controller(command for 


DC motor supply voltage) 


352 Digital Control Systems 


the position controller, which represents the reference signal for the internal speed 
loop. The rise time is practically the same as the one obtained in simulation (840 
ms). Figure 8.32c,d gives the evolution of the speed and of the speed controller 
output signal which will drive the DC motor supply voltage. For these last two 
figures the time scale is the same as for the “position” but the number of samples is 
different since the sampling frequencies in the two loops are different. 


8.5 Position Control by means of a Flexible Transmission 


The flexible transmission has been described in Chapter 7, Section 7.5.4. In this 
Section we will discuss the design of the controller for the position control of the 
third pulley (see Figure 8.33), based on the identified model. The control input is 
the reference for the axis position of the first pulley. It was shown in Section 7.5.4 
that the system has two very low damped vibration modes. It is operated with a 
sampling period of 50 ms. The identified model (open loop) is 


Alq!) =1-1.609555q7! +1.87644q ° —1.49879q > +0.88574q + 
B(q"') = 0.3053q7! + 0.3943q 7 
d=2 


AXIS 
POSITION POSITION 
TRANSDUCER 


CONTROLLER A Ra 
CONTROLLER ‘ 


P ref 


Figure 8.33. Digital control of a flexible transmission 
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The frequency characteristic of this model has been presented in Figure 7.24. The 
two vibration modes of the model are characterized by œo = 11.949 rad/s, C= 
0.042 and wg = 31.462 rad/s, ¢ = 0.023. The model has an unstable zero (because 
Ibz>lb 1). 

Since the model has an unstable zero the pole placement strategy will be used 
for controller design. It is desired to get a regulation and a tracking behavior 
characterized by a pair of well damped dominant poles, corresponding to the first 
vibration mode of the flexible transmission. The controller should also assure 
certain robustness specifications in terms of modulus margin, delay margin and 
maximum value of the modulus of the input sensitivity function at high 
frequencies. The performance and robustness specifications are summarized next: 


e Tracking dynamics: discretization of a second-order continuous time 
system with @p = 11.94 rad/s and €= 0.9 (Rise time tr ~ 0,285s which 
corresponds to tr ~ 6T;) 

e Zero steady state error (controller should include an integrator) 

e Dominant poles of the closed loop corresponding to the discretization of a 
second-order continuous time system with œo = 11.94 rad/s and ¢ = 0.8; 

e Modulus margin: AM > 0.5; delay margin: AT = 0.05s 

° [Sup (TIlmax < 10 dB for f > 0.35 f, 


A first controller design, for which only the dominant poles have been specified, 
leads to the sensitivity functions S,, and S„p shown in Figures 8.34 and 8.35 
(curves A). 
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Figure 8.34. Output sensitivity functions for various controllers 
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Figure 8.35. Input sensitivity functions for various controllers 


The resulting modulus margin AM =0.498 is slightly less than the desired 
value. The delay margin At =0.043s is less than the desired value and the 
maximum of Suq] at high frequencies is over the required value 70 dB (see 
Table 8.7). 

The number of closed loop poles that can be specified for a minimum size of 
the controller (ng = ng = 4) is in this case 


np natng+tnytd-l 8 


Since one has specified only a pair of poles corresponding to the first vibration 
mode but with ¢ = 0.8, it results that all the other poles for the closed loop have 
been implicitly set to zero (i.e. aperiodic poles at 0.5 f, ). Therefore controller (A) 
will damp the poles corresponding to the first vibration mode without changing the 
frequency but, in the mean time, it will accelerate and strongly damp the second 
vibration mode (z=0 corresponding to @p=62.8 rad/s and ¢ =/). This requires an 
important control effort in a frequency region where the gain of the system is low 
and, consequently, a high value of |S„p| at high frequencies will result. 

In order to avoid this phenomenon, it is necessary to specify a second pair of 
poles corresponding to the second vibration mode, with a damping equal or higher 
to the open loop value. Increasing the desired value of the damping will induce an 
increasing of |S„p| in this frequency region. Thus a second pair of desired closed 
loop poles is selected with @)=31.46 rad/s and ¢ = 0.15 (this value of the damping 
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Table 8.7. Specifications, and achieved modulus margin, delay margin and maximum |Syp| 
for various controllers 


Modulus | Delay | Supl 
Hs (qh | HRD Closed loop poles margin margin | Max 
(dB) (s) (dB) 
Dominant Auxiliary 
@p = 11.94 0.498 
A} iq! C=0.8 (-6.06) | 0.043 | 18.43 
Og = ` : 
B| iq! C=0.8 ut (-5.65) | 0.062 | 6.24 
(1-0.2q71)4 
mE 0 = 31.46 ei 
Og = É ; 
C| ig! | 1q! =0 aes (-5.29) | 0.057 | 1.5 
q q 6=0.8 (1-0.24-)4 ; 


is not critical). For the remaining poles to be assigned, as indicated in Chapter 3, 
Section 3.6, it is wise to select aperiodic poles located on the real axis between 
0.05 and 0.5. These poles will have a beneficial effect upon the maximum value of 
[Supl at high frequencies. The remaining four poles have been set to 0.2 (since four 
poles have been already assigned). The frequency characteristics of S,, and S„p for 
the new controller are represented in Figures 8.34 and 8.35 (curves B). The new 
controller satisfies the imposed specifications (see Table 8.7). 


Figures 8.36 and 8.37 show the real time results obtained with controller B. Figure 
8.36 corresponds to a step change on position reference. One observes that the rise 
time of the real system is close to the specified one (67, plus the delay of 2T). 


Figure 8.37 illustrates the behavior in regulation for a position disturbance 
followed by an instantaneous release (it is the return to the equilibrium position 
that is interesting for performance evaluation in regulation). 

A detailed examination of the control signal (see Figures 8.36 and 8.37) shows 
the presence of a high frequency component without effect on the output (the 
position of the third pulley), since this frequency region is far beyond the band pass 
of the closed loop. 

This phenomenon is even visible on the real system, where the position of the 
first pulley will follow to a large extent the control signal (the local position control 
of the first pulley has a high band pass). The input sensitivity function, in fact, will 
amplify by a few dB the high frequency measurement noise (which is interpreted 
as a disturbance). To counteract this effect it is sufficient to open the loop at high 
frequencies, by introducing in the controller a fixed part of the form Hg =1 + q 
(the controller gain will be zero at 0.5f,), and to re-compute the controller with the 


same specifications. 
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Figure 8.36. Position step response of the flexible transmission (controller B) 
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Figure 8.37. Flexible transmission — rejection of a position disturbance (controller B) 
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Figure 8.38. Position step response of the flexible transmission (controller C) 


1.5 


Flexible Transmission: Output 


Amplitude (Volt) 


-1.5 


T T T T 


L L 


13 


jd 
14 15 16 17 18 
Time (s) T = 50 ms) 


Flexible Transmission: Control Signal 


Amplitude (Volt) 


T T T T 


L 


L 


Figure 8.39. 


13 


Flexible transmission — rejection of a position disturbance (controller C) 


14 


15 


16 


Time (s) (T, = 50 ms) 


17 18 


357 


358 Digital Control Systems 


Table 8.8. The parameters of the RST controllers (B and C) for the flexible transmission 


Controller B Controller C 


Coefficients of p 


olynomial R(q~) 


R(O) = 0.497161 
R(1) = -1.009731 
R(2) = 0.622142 


R(3) = -0.186272 
R(4) = 0.285405 


R(0) = 0.307895 
R(I) = -0.515832 
R(2) = -0.037637 


R(3) = 0.452544 
R(4) = -0.165905 
R(5) = 0.167641 


Coefficients of polynomial S(q~/) 


S(0) = 1.000000 
S(1) = -0.376884 
S(2) = -0.256739 


S(3) = -0.239733 
S(4) = -0.126644 


S(0) = 1.000000 
S(1) = -0.376884 
S(2) = -0.256739 


S(3) = -0.181950 
S(4) = -0.109785 
S(5) = 0.074642 


Coefficients of polynomial T(q`}) (identical for B and C) 


KO) = 1.429225 
T(1) = -2.839061 
T2) = 3.181905 


1(3) = -2.687952 
T(4) = 1.594832 
KS) = -0.576414 


K6) = 0.118277 
T(7) = -0.012656 
T(8) = 5.488E-04 


Coefficients of polynomials B„(q 7) and A,, (q^) (identical for B and C) 


Am(0) = 1.000000 
B,,(0) = 0.124924 
A (1) = -1.129301 
B,,(1) = 0.087209 
Am(2) = 0.341434 


The characteristics of this controller (C) are summarized in Table 8.7. The 
corresponding frequency characteristics of the sensitivity functions are shown in 
Figures 8.34 and 8.35 (curves C) and the real time results are presented in Figures 
8.38 and 8.39 (to be compared with Figures 8.36 and 8.37). 

The parameters of the controllers B and C are given in Table 8.8. 


8.6 Control of a 360° Flexible Robot Arm 


Figure 8.40 gives a view of the 360° flexible robot arm. 

It is constituted by two aluminium sheets, each one is 1m long and 10cm wide, 
with a thickness of 0.7mm. The two sheets are coupled every 10cm by a rigid 
frame. The system is very flexible and presents many low damped vibration 
modes. The energy is essentially concentrated in the first three vibration modes. 
The sampling frequency (20 Hz) has been chosen such that these three vibration 
modes lie between 0 and 0.5 f, . Data acquisition is performed through anti aliasing 


filters. The block diagram of the control scheme is given in Figure 8.41. One of the 
extremities of the arm is directly coupled to the axis of a DC motor. The 
corresponding local position loop contains a cascade control of motor current, 
speed and position (measured by a potentiometer type transducer). The band pass 
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Figure 8.40. 360° Flexible robot arm (Laboratoire d’Automatique de Grenoble, 
INPG/CNRS/UJF) 


of this loop is higher than the frequency of the first vibration mode. 

The output of the system is the position of the free end of the arm. The 
measurement of the position of the free end is done by combining information 
upon the position of the motor axis (provided by an incremental transducer) and 
those provided by a carried on measurement device (including a light beam and a 
mirror), which gives the angular position with respect to the motor axis position 
(for details concerning the measurement device see Landau et al. 1996). 


ALLUMINIUM 


DETECTOR 


| COMPUTER 


POSITION 


Figure 8.41. Position control scheme for the 360° flexible robot arm 
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The measurement system allows one to cover a rotation from 0 to 360°. The 
control signal provided by the computer is the reference position for the motor 
axis. 

The identified and validated model for the case without load is (Langer and 
Landau 1999) 


A(q~') =1- 2.1049 q™' + 1.04851 q ° + 0.33836 q™° + 0.46q~* 
— 1.5142 q7% + 0.7987 q~° 

B(q_') = 0.0064 q™' + 0.0146 q~? — 0.0697 q™° + 0.044 q~* 
+ 0.0382 q~” — 0.007 q~° 

d=0 


The frequency characteristic of this model is shown in Figure 8.42. 
This model is characterized by three very low damped vibration modes 
(@, = 2.6173, C, = 0.018; @) = 14.4027, C5 = 0.025; a3 = 48.1169, C3 = 0.038). 


The pole — zero map is shown in Figure 8.43. One notes the presence of unstable 
zeros. The unstable zeros with positive real part correspond to continuous time 
unstable zeros (non-minimum phase system). Since the model has unstable zeros 
the pole placement strategy will be used for the controller design. 


Flexible Robot Arm : Magnitude Bode Diagram 


Magnitude (dB) 


Frequency (fff) 


Figure 8.42. Frequency characteristics of the identified model for the 360° flexible robot 
arm 
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Flexible Robot Arm : Pole-Zero Map 
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Figure 8.43. Pole — zero map of the identified model for the 360° flexible robot arm 


The design of the controller will be done using the iterative pole placement 
design with shaping of the sensitivity functions, by simultaneous tuning of Hg 


(respectively Hp) and of auxiliary poles (see Chapter 3, Section 3.6 and (Prochazka 


and Landau 2003)). The effective computations have been carried on with 
ppmaster (MATLAB®Y (Prochazka and Landau 2001). The specifications are the 
same as in (Langer and Landau 1999): 


Tracking dynamics: discretization of a second-order continuous time 
system with wj=2.6173rad/s and ¢ = 0.9 

Zero steady state error (controller should include an integrator) 

Dominant poles of the closed loop system corresponding to the 
discretization of a second-order continuous time system with @p=2.6173 
rad/s and ¢ = 0.8 

Modulus margin: AM = 0.5(-6 dB); delay margin: Az 2 0.05s (17, ) 
Constraints on the input sensitivity function |S„p (q1): < 15 dB at low 


frequencies (< 4 Hz); <0 dB from 4.5 Hz to 6.5 Hz; < 15 dB from 6.5 Hz 
to 8 Hz; <10 dB from 8 to 10 Hz (f,=20Hz) 


The low value imposed on |S„p| between 4.5 Hz and 6.5 Hz (0.225 to 0.325 fif,) is a 
constraint resulting from the low value of the open loop gain and the uncertainties 


° To be downloaded from http//:landau-bookic.lag.ensieg.inpg.fr 
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upon the model in this frequency region. The bound |S,„p| at high frequencies will 
limit the effect of the measurement noise upon the control signal. 

The templates for the modulus of the sensitivity functions are represented in 
Figures 8.44 and 8.45 (dotted lines). 

The desired dominant closed loop poles are chosen as indicated in the 
specifications, and an integrator is introduced in the controller (Hs = ing” ). 
Note that it is not necessary to damp the second and third (high frequency) 
vibration mode because closed loop band pass (defined by the dominant closed 
loop poles), the disturbances and the tracking model dynamics are all are at low 
frequencies. Therefore these poles will be kept unchanged by specifying them as 
poles of the closed loop (see the partial internal model design, Section 3.5.5). 

The result of this first design is a controller for which |S\,| and |S,,| are far 


outside the imposed templates at high frequencies (Figures 8.44 and 8.45 — curves 
A). In such situations auxiliary poles have to be added. The total number of poles 
which can be specified (without increasing the size of the controller) is 


Np=Nnygtngtd+ny, =]1=12 


Six poles have been have been already assigned. It is therefore possible to add 
auxiliary poles of the form 


Pp(z)=(+pz!)f ; -05< p< -0.05 


Taking p, = —0.5 one gets a controller leading to sensitivity functions which are 
slightly above the templates in two frequency regions (Figures 8.44 and 8.45 — 
curves B). |S},| is above the template around / Hz and |S„p| is above the template 
between 4 and 6 Hz. First, to improve the design, we will consider the introduction 
of a resonant pole—zero filter H ṣ, / P, in Syp. The continuous time filter, which will 
serve for the computation of the discrete time filter, is chosen with a resonance 
frequency fọ =/Hz (6.28 rad/s). The damping for the denominator is chosen as 
Cden =0.8 (in order that the auxiliary poles which will be introduced be well 
damped). The desired attenuation is M; = -5.5 dB, leading to num =0.424. The 
characteristics of the discrete time filters Hs, and P, are given in Table 8.9'°. The 


sensitivity functions obtained with the new controller are illustrated in Figures 8.44 
and 8.45 — curves C. It remains to correct now the frequency characteristics of |S,,,]| 


10 Since the resonace frequency of the filter is below 0.17 fs, the filter design can be done with an 
excellent precision directly in discrete time. 
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Flexible Robot Arm: Syp Magnitude Frequency Responses 
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Figure 8.44. Flexible 360° arm. Output sensitivity function (|Syp|) for various controllers 
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Figure 8.45. Flexible 360° 
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between 4 and 6 Hz. A resonant pole-zero filter Hp /P; in |Syp| is considered. It 


will be centred around 5 Hz. Choosing fọ = 4.7 Hz, M, = -16.4 dB and Cen =0.9, 
one gets the desired results (Figures 8.44 and 8.45 — curves D). The characteristics 
of Hp and P,are given in Table 8.9. 


Table 8.9. Specifications of the various controllers for the 360° flexible robot arm 


Hg(q"!) He(q7)) Closed loop poles 


Dominant Auxiliary 


(1-0.5q'!)° 
o = 6.28 


(1 —0.5q7!)® 
py = 6.28 
6=08 
œ = 40.1 
6=0.74 


8.7 Control of Deposited Zinc in Hot Dip Galvanizing (Sollac- 
Florange) 


This application is interesting for several reasons: 


e It clearly shows the benefit of a good control 

e It points out the interest of using digital RST controllers for processes with 
a long time delay 

e It illustrates the concept of the ’open loop adaptive control” 


A detailed presentation of this application can be found in Fenot et al. (1993a). 
8.7.1 Description of the Process 
The objective of the galvanizing line is to obtain galvanized steel with formability, 


surface quality and weldability equivalent to uncoated cold rolled steel. The variety 
of products is very large in terms of deposited zinc thickness and steel strip 
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thickness. The deposited zinc may vary between 50 and 350 g/m’ (each side) and 
the strip speed may vary from 30 to 180 m/mn. 

The most important part of the process is the hot-dip galvanizing. The principle 
of the hot-dip galvanizing used at Sollac — Florange is illustrated in Figure 8.46 
Preheated steel strip is passed through a bath of liquid zinc and then rises vertically 
out of the bath through the stripping “air knives” which remove the excess zinc 
before it solidifies (Figure 8.47). The remaining zinc on the strip surface solidifies 
before it reaches the rollers which guide the finished product. The effect of air 
knives depends on the air pressure, the distance between the air knives and the 
strip, and the speed of the strip. Nonlinear static models have been developed for 
computing the appropriate pressure, distance and speed for a given value of the 
desired deposited zinc. 

The objective of the control is to assure a good uniformity of the deposited zinc 
whilst guaranteeing a minimum value of the deposited zinc per unit area. Tight 
control (i.e., small variance of the controlled variable) will allow a more uniform 
coating and a reduction of the average quantity of deposited zinc per unit area. As a 
consequence, in addition to quality improvement, a tight control of the deposited 
zinc per unit area has an important economic impact since the average 
consumption for a modern galvanizing line is of the order of 40 tons per day. 

The main difficulty for control results from the fact that measurement of the 
deposited zinc can be made only on the cooled finished strip. The transducers are 
located more than 100 m after the zinc bath, which results in an important delay 
between the action of the pressure at the level of air knives and the measurement of 
its effect on the finished product. The digital RST controller is well suited for the 
control of such processes with long delay for which PID control cannot be used. 

In addition, the delay will depend upon the speed of the steel strip which may 
vary in a ratio | to 3. Furthermore, the dynamic behavior will also depend upon the 
position of the steel strip with respect to the air knives. 


8.7.2 Process Model 


The static model of the hot dip galvanizing process can be approached by 


m -Ko fe +8, 
P 


where m is the deposited mass per unit area, K is a constant of proportionality, D is 
the distance between the air knives and the strip, P is the air pressure and V is the 
strip speed. ¢,, accounts for unpredictable effects and/or modelling errors. At 
SOLLAC Sainte Agathe, the control variable is the air pressure. 

A linearized model around an operating point (Po,Do, Vo) can be obtained using 
a standard Taylor series expansion for variations of pressure (AP), speed (AV) and 
distance (AD). It has the form 
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lV, 
m= KDy p GAD +BAv—pAP +6, 
0 


where Po,Do, Vo are the values of the pressure, distance and speed defining the 
operating point and AP, AD, AV, are the variations of these variables. It can be seen 
that using the pressure as the control variable one can compensate for the 
disturbances created by variations of distance and speed as well as by the term én. 
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Figure 8.46. Scheme of the hot dip galvanizing process at Sollac - Florange 
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Figure 8.47. Details of the hot dip galvanizing process 


The pressure in the air knives is regulated through a pressure loop, which can be 
approximated by a first-order system. The delay of the process will depend linearly 
on the steel strip speed. Therefore, for describing the relationship between the 
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variations of pressure and the variations of the deposited mass, one can consider a 
continuous time dynamic model of the form 


=r 
O H pe 
1+sT V 


where L is the distance between the air knives and the transducers and V is the strip 
speed. 

When discretizing this model, the major difficulty comes from the variable time 
delay. In order to obtain a controller with a fixed number of parameters, the delay 
of the discrete-time model should remain constant. Therefore, the sampling period 
is tied to the strip speed (it is an “open loop adaptation”) in order to get a discrete 
time model of constant complexity, using the formula 


G 


: ; d=integer 


where d is the discrete-time delay (integer) and dis an additional small time-delay 
due to implementation. 

The corresponding linearized discrete-time model, which has been identified 
around various operating points, has the form 


Gq Oa") 


H(q')= 
l+aq" 


with d = 7. The fractional delay (which corresponds to the presence of an 


additional term bq”) is negligible because of the way the sampling period Ts is 
selected and this was confirmed by the model identification procedure. However, 
the parameters of the model, given above, will depend on the distance D and on the 
speed V. 


8.7.3 Model Identification 


The plant is formed by the air pressure control loop and the coating process. The 
control input to the process is the reference of the air pressure control loop, the 
output of the process is the measured deposited mass per unit area (see Figure 
8.48). The identification of the discrete time model of the plant has been done by 
superposing a PRBS to the reference for the pressure loop, as illustrated in Figure 
8.48. 
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Figure 8.48. Block diagram of the identified plant (input: Ap, output: Am) 


The input used was a PRBS (Pseudo Random Binary Sequence) of a magnitude of 
+4% with respect to the static pressure (Po). The PRBS was generated by a shift 
register with N = 5 cells and a clock frequency equal to half of the sampling 
frequency (length of the sequence: 64); 100 to 160 (average: 128) measurements 
have been used for the various identifications made in different regions of 
operation. The choice made for the PRBS allowed at least one full sequence to be 
sent for each experiment and yielded the largest pulse width (10 Ts) comparable 
with the rise time of the process (including the time delay). As both sides of the 
steel strip have to be galvanized, and because of the non symmetric position and 
physical realization of the two actuators, both “front” side and “back” side models 
have been identified. Data acquisition has been done using over sampling as 
indicated in Chapter 7, Section 7.1.3. 

A comparative study has shown that for this application the output error 
identification method gives the best results in terms of model validation. 

The identification of the process model around various operating points, 
defined by the strip speed and the distance between the air knives and steel strip, 
has shown a significant variability of the identified parameters. This has imposed 
the use of an “open loop adaptive control” in order to assure good performance in 
all operating points. 


8.7.4 Controller Design 


RST controllers (with integrator behavior) have been designed for the various 
operation regions using tracking and regulation with independent objectives (see 
Chapter 3, Section 3.4) since the model always has stable zeros (the sampling 
period is tied to the steel-strip speed). An important requirement is the achievement 
of a delay margin of 2 T, 


The polynomial P(g“) defining the closed loop poles will have a maximum 
degree given by 
deg P(q `!) < (n, +ng+d+ny. =1) 


In this application one gets (n H, = 1) 
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ngtngt+d+ny,, -1=9 


and therefore one can specify nine poles. The real poles of the model vary from 
0.15 to 0.4 over the entire range of operating points. Two poles have been assigned 
to 0.2 and 0.3 (respectively 0.4 depending on the operating region and the values of 
the identified pole of the model) and the other seven auxiliary poles have been 
assigned at 0.1!!. These auxiliary poles introduce an attenuation at high frequencies 
(outside the band pass of the system) and improve the robustness of the system (in 
particular, the delay margin is increased) without affecting the regulation 
performance at low frequencies. 

Figure 8.49a gives the Nyquist plot for the case where only two poles are 
specified for P(q~/) (0.2 and 0.3) and Figure 8.49b allows one to see the effect of 
the additional auxiliary poles (seven poles at 0.1). One observes an important 
increase of the delay margin from 70.9 s to 25.7 s (T, = 12s) since the Nyquist plot 


does no longer intersect the unit circle at high frequencies. The introduction of the 
auxiliary poles also produces a significant reduction of the magnitude of the input 
sensitivity function at high frequencies and, therefore, a reduction of the stress of 
the actuator in this frequency region. The other robustness margins have 
satisfactory values with or without the auxiliary poles (AM > - 6dB AG > 2 Agd> 
60 deg). 

Simulation tests have shown that the closed loop system tolerates delay 
variations of + 7, (one sampling period corresponds to about 15% variations of the 
delay) and +50% variations of other model parameters (b; and aj). 

Procedures for taking into account the quantization, the saturation and the 
bumpless transfer from open loop to closed loop (see Sections 8.1.3 through 8.1.5) 
have been implemented. 

Since the speed of the steel strip is measured, it was also possible to make an 
“open loop compensation” of this disturbance. This has a beneficial effect upon the 
regulation transient; however, it is the integrator included in the controller which 
cancels the effect of this disturbance in steady state. 


8.7.5 Open Loop Adaptation 


To maintain the performance of the control system, the controller is adapted as a 
function of: 


e Speed of the steel strip 
e The distance between the air knives and the steel strip 


In addition to the adaptation of the sampling frequency as a function of the speed 
of the steel strip, the operation range of the hot dip galvanization process has been 
divided into three speed regions (the speed of the strip may vary from 30 m/min to 


11 The choice made for the dominant and auxiliary poles is close to the choice made in the example of 
the internal model control of systems with time delay discussed in Chapter 3, Section 3.5.7. 
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Figure 8.49a,b. Nyquist plot for hot dip galvanizing (a,=-0.2, d=7): a Closed loop poles: 
0.2; 0.3; b Closed loop poles. 0.2; 0.3; 7 x 0.1 
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180 m/min) and in three regions for the distance between the air knives and the 
steel strip which lead to a total of nine regions of operation, each one defined by a 
range of speeds and a range of distances. An identification of the plant model has 
been done for various operating points within each region of operation. A 
controller design on the basis of a model estimated for the central operating point 
within a region has been designed, and tested in simulation on the various 
identified plant models for the corresponding region. The controllers have been 
stored in a table. The controllers are switched when the system moves in a new 
region of operation. A bumpless transfer from one controller to another is 
implemented. In addition hysteresis is used to avoid unnecessary switching when 
one operates very close to the regions boundaries. 


8.7.6 Results 


Figure 8.50 shows one of the typical results obtained when one of the sides is 
under digital regulation and the other side is under computer aided manual control 
(the operator has on display a moving short time history of the deposited zinc and 
applied pressure). 

The analysis of this curve points out two relevant facts when closed loop digital 
control is used: 


e A smaller dispersion of the coating thickness (the standard deviation on the 
side where the feedback control was applied is about 30 % smaller than on 
the side under manual control). This assures a better finished product 
quality (extremely important for the use in the automotive industry, for 
example). 

e The average quantity of deposited zinc is reduced by 3% still guaranteeing 
the specifications for minimum zinc deposit. This corresponds to a 
significant reduction of the zinc consumption and to an important economic 
impact. 


Table 8.10 summarize the results obtained in different operation regions. 


Table 8.10. Performances of the digital control of deposited zinc in the hot dip galvanizing 
(Sollac-Florange) 


Digital control Computer aided manual control 


Distanc Speed Mean | Stan | Out of Mean Stan Out of 
cam e | (m/min) | value | dev. | reference value dev. | reference 
% % +10% % % +10% 


[10 | 35-100 | 100 [29 | o | 99 [52] 59 | 
[ıs | 7 | 10 fis] | w f2] | 
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Figure 8.50. Typical performances for the digital control of deposited zinc in the hot dip 
galvanizing (SOLLAC-Florange) 


8.8 Concluding Remarks 


Digital controllers can be implemented on a large variety of hardware. This 
implementation, however, has to be done by paying attention to a number of issues 
listed here: 


Specification of the desired performances taking into account the actuator 
power and band pass, the time response of the plant in open loop and the 
desired robustness margins. 

Taking into account the computation delay. 

Taking into account the characteristics of the digital to analog converter. 
Introducing anti-saturation schemes. 

Implementation of a bumpless transfer procedure from open loop operation 
to closed loop operation. 
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For applications where significant variations of the dynamic model of the plant 
occur with the change of the operating points, it is recommended to proceed as 
follows: 


e To identify the model of the plant in the various regions of operation. 

e To design a controller for each region of operation assuring desired 
performance and robustness. 

e To store the parameters of the controllers in a table. 

e To change the parameters of the controllers when the system moves in a 
new region of operation by downloading the values of the controller 
parameters stored in the table. 


This procedure is called “open loop adaptation”. 

In continuous production processes it is very useful to measure the quality of 
the control from the histogram of the regulated variables. 

The application examples presented in this chapter (there are many others) have 
illustrated how the methodology for system identification and control design has to 
be used in order to implement a high performance control system. 
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Astrém K.J., Wittenmark B. (1997) Computer Controlled Systems - Theory and 
Design, 3rdedition, Prentice-Hall, Englewood Cliffs, N.J. 
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Identification in Closed Loop 


The techniques for model identification of plants operating in closed loop together 
with the corresponding validation techniques are presented in this chapter. The 
possibilities offered by the identification in closed loop for obtaining improved 
models for controller re-design leading to better performance are illustrated in the 
final part of the chapter. 


9.1 Introduction 


There exist situations in practice where the plant model should be identified in 
closed loop (i.e. in the presence of a controller): 


e The first case is related to the plant dynamics characteristics. If the plant 
has an integrator or it is unstable, or an important drift of the operating 
point occurs, it is very difficult and, in some situations, very dangerous to 
operate it in open loop. 

e The second case is related to systems where a controller is already 
operating and where it is neither possible nor recommended to open the 
loop in order to acquire data for the system identification. 

e The third case corresponds to situation where the controller has been 
designed based on a plant model identified in open loop and where, for the 
purpose of improving the achieved performance, it is necessary to carry on 
model identification in closed loop for the re-design of the controller. 


It is this last aspect that has gained importance in the last years since identification 
in closed loop on one hand provides in general better models for design than open 
loop identification and on the other hand allows tuning of a controller without 
opening the loop. 

The objective of identification in closed loop is to obtain a plant model 
describing as precisely as possible the behavior of the real closed loop system for a 
given controller. It is also expected that this model identified in closed loop will 
allow redesigning of the controller in order to improve the performance of the real- 
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time control system. In other words, (assuming that the real system is linear around 
an operating point), the objective of system identification in closed loop is to 
search for a plant model that in feedback with the controller operating on the true 
plant will lead to a closed loop transfer function (sensitivity function) that is as 
close as possible to that of the real closed loop system. 

It has been shown in Landau and Karimi (1997b), Landau and Karimi (2001b), 
as well as in many other references, that identification in closed loop, provided that 
appropriate identification algorithms are used, leads in general to better models for 
controller design. It is effectively possible to improve the quality of the identified 
model in the frequency regions that are critical for controller design. These 
frequency regions are those where the Nyquist plot of the open loop transfer 
function is close to the critical point [-/, 70]. 

In order to understand the potential of the identification in closed loop as well 
as the difficulties which can be encountered, let us consider the case of plant model 
identification in closed loop where the external excitation is added to the controller 
output (see Figure 9.1a). Figure 9.1b shows an equivalent scheme that emphasizes 
the transfer function between the external excitation r, and the plant input u, as 
well as the effect of the measurement noise upon the plant input. Assume that the 
external excitation is a PRBS that has almost constant frequency spectrum from 0 
to 0.5f;. 

One observes that the effective plant input corresponds to the external 
excitation filtered by the output sensitivity function S,, whose magnitude has a 
maximum in the frequency regions close to the critical point [-/, j0] (see Chapter 2, 
Section 2.6.2). Therefore the frequency spectrum of the effective input applied to 
the plant will be enhanced in these frequency zones. As a consequence, the quality 
of the identified model in these critical regions for stability and performance will 
be improved. Unfortunately, in the meantime, the feedback introduces a correlation 
between the measurement noise and the plant input. This leads to an important bias 
on the estimated parameters if one would like to identify the plant model with open 
loop techniques based on uncorrelation (see Chapter 6). One may expect that the 
open loop identification techniques based on the whitening of the prediction error 
will still provide good results in closed loop operation. However, as a consequence 
of feedback, interdependence between the noise model and the plant model occurs 
and the parameter estimates will also be biased (Karimi and Landau 1998). 

Therefore, for a good identification in closed loop operation one needs 
identification methods that take advantage of the “improved” characteristics of the 
effective excitation signal applied to the plant input but which are not affected by 
the noise in the context of feedback. An efficient solution for this problem is 
provided by the “closed loop output error’ methods (CLOE) that will be presented 
in Section 9.2. 

The schemes for data acquisition in closed loop operation have been already 
presented in Chapter 7 (Section 7.1). 
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Figure 9.1a,b. Identification in closed loop: a excitation added to the control output; b 
equivalent representation 


9.2 Closed Loop Output Error Identification Methods 


9.2.1 The Principle 


The principle of closed loop identification methods is illustrated in Figure 9.2. The 
upper part represents the true closed loop system and the lower part represents an 
adjustable predictor of the closed loop. This closed loop predictor uses a controller 
identical to the one used in the real time system. 

The prediction error between the output of the real time closed loop system and 
the closed loop predictor (closed loop output error) is a measure of the difference 
between the true plant model and the estimated one. This error can be used to adapt 
the estimated plant model such that the closed loop prediction error is minimized 
(in the sense of a certain criterion). In other words the objective of the 
identification in closed loop is to find the best plant model which minimizes the 
prediction error between the measured output of the true closed loop system and 
the predicted closed loop output. 

In Figure 9.2 the external excitation is superposed to the reference. However it 
can be superposed to the controller output as shown in Figure 9.3 (the reference is 
not represented). In both cases the same parameter adaptation algorithm is used, 
although the characteristics of the identified model will be slightly different since 
in the first case (Figure 9.2) one tries to approximate the sensitivity function Sy 
while in the second case one tries to approximate the sensitivity function S,,. Use 
of these methods requires knowledge of the controller. 
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All the algorithms which will be presented are available in a MATLAB” 
toolbox CLID® (Adaptech) which can be downloaded from the book web site. 


Parameter 
Adaptation 
Algorithm 


Figure 9.2. Closed loop output error identification method (excitation superposed to the 
reference) 


9.2.2 The CLOE, F-CLOE and AF-CLOE Methods 


The algorithms will be introduced using, as an example, a first order type plant 
model and then the general formulas will be given. 


w 
Plant 


Parameter 
Adaptation 
Algorithm 


Figure 9.3. Closed loop output error identification method (excitation added to the 
controller output) 
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Closed Loop Output Error (CLOE) 
The closed loop system is described by: 


y(t + 1) = —a,y(t)+ bult) = 0" bo (t) (9.2.1) 
0" =|a,,b)]; dole)’ =Evehule)] (9.2.2) 
lB sn 023) 


The plant model is described by Equation 9.2.1 and the control u is given by 
Equation 9.2.3. r,(t) is the external excitation superposed to the controller output 
(see Figure 9.3). 

In the case where the external excitation is superposed to the reference, the 
signal r,(t) is replaced by (see Figure 9.2) 


-1 
r,(t)= : an rle) (9.2.4) 


The adjustable closed loop predictor is described by 
S° (e+1)= -â ele) bi leale) = A" (0) (9.2.5) 
$(t +1) =—G, (¢ +1) 9(t) +, (t+ ált) = A(t +1)’ glt) (9.2.6) 


At) =a ().0; 90)” = 50,00) (9.2.7) 


n Rq) n 
=— r, 9.2.8 
ii(t) aan H(t) +r, l) (9.2.8) 


where }°(¢+1) and $(t+1) represent the a priori and the a posteriori outputs of 
the closed loop predictor. u(t) is the control signal delivered by the controller 


(which is identical to the one used on the true system) using the a posteriori output 
of the predictor and not the measured outputs (compare Equation 9.2.8 with 
Equation 9.2.3 ). 

The closed loop prediction error is given by 


Ec, (t+) =y(t+1)-3F°(t41) apriori (9.2.9) 
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ECL (¢ + 1) = y(t + 1)- H(t + 1) a posteriori (9.2.10) 


The parameter adaption algorithm to be used is similar to those used for open loop 
identification: 


O(t +1) = O(t)+ F(1)O(teq, (+1) (9.2.11) 


F(t+iy' =A, (FC) +4 ~ eM) OC)! ; 0<4,(t)<10<4,(1)<2 (9.2.12) 


ye ehle) 
Ec, (t +1) ETA (9.2.13) 


O(t)= 4A) (9.2.14) 


The fundamental differences with respect to the open loop output error are that the 
adjustable predictor and the regressor vector are different. 


Note: If S(q') = 1 and R(q”) = 0 one operates in open loop and the open loop 
output error algorithm is obtained as a particular case. 
In the general case Equation 9.2.1 is replaced by 


y+) =-A (q yA) +B (qult -d)+ Aq wit +1). (9.2.15) 


where w represents the noise effect. The noise w is supposed to be centered, of 
finite power and independent with respect to the external excitation r„. Equations 
9.2.5 and 9.2.6 keep the same form with 


a a 


At)” =la eâ, (0.5, (0)04,, O (9.2.16) 
a(t)’ =F Slt}... -n4 + D,a(t—d)....,a(¢—ng +1-d)| (9.2.17) 


and the parameter adaptation algorithm is the one given by Equations 9.2.11 
through 9.2.14. 

The convergence of this algorithm (CLOE), in the absence of noise, is subject 
to a sufficient condition: the transfer function 


Sz!) Ay 


; 2>A, >maxd,(t 9.2.18 
Pe) 2 2 a(t) ( ) 


should be strictly positive real, where the polynomial 


Identification in Closed Loop 381 


P(z!) = A(z) 8(z7!) 42-4 BR). (9.2.19) 


defines the poles of the closed loop. 

It has been shown that, under the sufficient condition of Equation 9.2.18 , the 
closed loop output error (CLOE) gives asymptotically unbiased parameter 
estimates in the presence of noise (independent with respect to the external 
excitation) if the estimation model and the true model have the same structure. 


Filtered Closed Loop Output Error (F-CLOE) 

In order to relax the condition of Equation 9.2.18 one can filter the vector ø(t) 
through S(q7')/ Paq’) where Pq!) is an estimation of the polynomial 
defining the poles of the closed loop. If an estimated plant model 
q 4 B(q"')/ Alq’) is available, one can compute 


Pa = ATDS +g BTR). (9.2.20) 


and in the parameter adaptation algorithm one uses 


S(q') 
at) => t). (9.2.21) 
P(q') = 


We get in this way the F-CLOE method. In this case, the transfer function of 
Equation 9.2.18 is replaced by 


Piz) dy 
P(z') 2 


; 2>A, >maxA,(t) (9.2.22) 


which should be strictly positive real. This condition is clearly easier to satisfy. 

A first estimation of the plant model is necessary in order to compute the filter. 
This estimation can be provided by AF-CLOE or X-CLOE methods (described 
next) as well as by identification in closed loop, using an open loop type 
identification method or using the model identified in open loop (if it is available). 


Adaptive Filtered Closed Loop Output Error (AF-CLOE) 
One may consider filtering ¢(t) through a time-varying filter S( q! )/ PC tq! ) 


where P( tq ) is the estimation at time ¢ of the polynomial defining the closed 
loop poles: 


P(t,q')=A(t,g” )S(q' )+q4B(t.q RCA) (9.2.23) 
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computed from the estimations of A( tg ) and B( tg ) available at time ¢. This 


leads to the AF-CLOE algorithm. 
In this case the vector ®(f) given in Equation 9.2.21 is replaced by 


S(q'') 


OO Fag) 


MO (9.2.24) 


9.2.3 Extended Closed Loop Output Error (X-CLOE) 


If it is assumed that the disturbance acting on the plant output can be represented 
by an ARMAX type model, Equations 9.2.1 and 9.2.3 become: 


y(t+1)=-A'(q7' y(t) + B* (qult -d)+C*(qelt)+elt+1) (9.2.25) 


R@') 
u(t)=— F y(e)+r, (e) (9.2.26) 


where e(t) is a Gaussian white noise and 


Cq')=l+q'C(q')=lt+aq' H.” 


is an asymptotically stable polynomial. 
X-CLOE is an identification method based on the whitening of the closed loop 
prediction error. An adjustable closed loop predictor of the following form is used: 


Ect (t) 


54) =-A oa) 4B Ca ila) 0a 
5°(¢4+1) (q+ b (tq at-d)+ Hq Sq) (9.2.27) 


TAOM AG) 
where 
l --20 D; 9.2.28 
ii(t) “wy (9.2.28) 
ÔT =[4(t),..54,, Ob Osby, Ohr Ohn, (O (9.2.29) 


pD =PO Ecis OE -ny +I) (9.2.30) 
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Ec (t) = SaD (9.2.31) 

Eat+D=y0+)- +D (9.2.32) 

Eq, (t+) = (t+) -8,(t4+1)" 6,0 (9.2.33) 
For 

A(t, q’) =A" (q), b (tq) = B (q) and Â (t,q"') = H'(q") 
where! 


H(q')=1+q"H (q) =1+C S- PA) (9.2.34) 


the closed loop prediction error is white noise (Landau and Karimi 2001b). 
The parameter adaptation algorithm is given by Equations 9.2.11 through 
9.2.14 where: 


At) =8.01) ; DA =4 A 


In the deterministic case (without noise) there is no any condition to be satisfied for 
stability. In the presence of an ARMA disturbance one obtains asymptotically 
unbiased parameter estimates under the sufficient condition that 


-— ; 2>A, >max/,(t (9.2.35) 
2 2 


is a strictly positive real transfer function (note that it is the same condition as in 
open loop identification using extended least squares or output error with extended 
prediction model). 


9.2.4 Identification in Closed Loop of Systems Containing an Integrator 
The identification methods presented previously allow a better estimation of a pure 
integrator than the open loop identification methods. However, if the existence of a 


pure integrator is known, it is better to take this into account. Two procedures can 
be used, and both require a modification of the controller used in the closed loop 


' From Equation 9.2.34 it results that ny = max(nç +g, np) : 
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adjustable predictor in order to preserve the input/output behaviour of the closed 
loop: 


1. The plant input is replaced by its integral and the output remains 
unchanged. In this case the equations describing the adjustable predictor 


become 
I (t+ =-A 6g DIO + B últ- ad) (9.2.36) 
g= RG) g 9.2.37 
with 
Aq =A- +A a= A-a) la) (9.2.38) 


2. The plant output is replaced by its variations and the input remains 
unchaged. In this case the plant output in closed loop is 


y= yO-yE-) =A-q"')y(t) (9.2.39) 


and the corresponding equations of the adjustable predictor are 


H(t) =-A (tg )I'O+ Bq ya'(t-d) (9.2.40) 

cpl R(q') ' 

u'(t-d)= C) +r, (t) (9.2.41) 
saD 


The closed loop prediction error is in this case 
Ee, (t+) = y'O-H° C+D (9.2.42) 


Figure 9.4a,b illustrates the modifications for the case when the external excitation 
is applied to the controller output. 


9.2.5 Model Validation in Closed Loop 


As in open loop identification, it is the model validation that will tell us on one 
hand if the identified model is acceptable and on the other hand it will allow us to 
select the best model among the models provided by various identification 
methods. 

The objective of the model validation in closed loop is to find what plant model 
combined with the current controller provides the best prediction of the behavior of 
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the closed loop system. The model validation in closed loop will depend upon the 
controller which will be used. 
Four validation procedures can be defined: 


1. Statistical validation tests on the closed loop output error (uncorrelation 
test between £, (t + 1) and ø^)) 


2. Closeness of the computed and identified poles of the closed loop system 

3. Closeness of the computed and identified sensitivity functions of the 
closed loop system 

4. Time response validation (comparison of time response of the real closed 
loop system and of the closed loop predictor) 


Statistical Validation 
The statistical validation follows the same principles as for open loop 
identification. However in this case one considers the residual prediction error 
between the output of the plant operating in closed loop and the output of the 
closed loop predictor. An uncorrelation test will be used. 

Using the schemes shown in Figure 9.2 (or Figure 9.3) where the predictor is 
given by Equations 9.2.5 through 9.2.8, one computes with the identified values of 
the parameters: 


e The correlations between the residual closed loop output error ¢¢,(¢+1) 
and the components of the predictor regressor vector A(t) (p(t) ,u(t-—d) 


and their delayed values) 
e The covariance of the residual closed loop output error 


This type of test is motivated on one hand by the fact that uncorrelation between 
the observations (the components of ¢(f) filtered or not) and the closed loop 


prediction error leads to unbiased parameter estimates and on the other hand this 
uncorrelation implies the uncorrelation between the closed loop output error and 
the external excitation. This means that the residual prediction error does not 
contain any information which depends upon the external excitation and therefore 
all the correlations between the external excitation and the output of the closed 
loop system are captured by the closed loop predictor. 
One defines 
Š F 
RÒ) weer (HS-i) (9.2.43) 
and one computes 


RÒ 


a a 72° 
a2 2 
GÈ (t) Lye] 


RN(i)= i=0,1,2,...,max(r4,n, +d) (9.2.44) 
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Figure 9.4a,b. Identification in closed loop of systems containing a pure integrator 
(A(q')=(1-q"')A, (q_')): a plant input replaced by its integral; b plant output 


replaced by its variations 


As a validation test one uses the criterion (Landau et al. 1997) 


RNO <=; =12,...,1 


VN L max 


where œ is the confidence interval (a typical value is 2.17 which corresponds to 
97% level of confidence) and N is the number of data (see Chapter 6). 

In many practical situations, from one set of input/output data several models 
can be identified using various methods (even a model identified in open loop may 
be available). A comparative validation is necessary in order to select the best 
model. The comparison indicators are the variance of the residual closed loop 


prediction error and max|RN Q) for each model. 
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Pole Closeness Validation 

If the model identified in closed loop in feedback with the controller used during 
identification allows one to construct a good predictor for the real system, this 
implies that the poles of the closed loop system and of the closed loop predictor are 
close (assuming that a persistent excitation has been applied for identification). As 
a consequence, the closeness of the closed loop predictor poles (which can be 
computed) and those of the real closed loop system (which can be identified by an 
open loop type identification between the external excitation and the output) will 
give an indication of the quality of the identified model. 

The closeness of the two sets of poles can be judged by a visual examination of 
the poles chart. It is however possible to quantify this closeness by evaluating the 
distance between the closed loop transfer function of the real system and of the 
predictor (see next). 


Sensitivity Functions Closeness Validation 

From the same arguments as above it results that if the identified model is good, 
the sensitivity functions of the closed loop predictor (which can be computed) are 
close to the sensitivity functions of the real system (which can be identified by an 
open loop type identification between the external excitation and the output). 

To some extent the closeness of the sensitivity functions can be assessed by 
visual inspection. Moreover it is possible to quantify rigorously the distance 
between two transfer functions by computing the Vinnicombe distance (see 
Appendix D). 

Extensive simulations and a large number of experimental results have shown 
that the statistical tests and the poles or sensitivity functions closeness give 
coherent results and allow a clear comparison between several models (Landau and 
Karimi 1997b). 


Time Domain Validation 

For the validation in the time domain, one compares the time responses of the 
closed loop system and of the closed loop predictor. Unfortunately in practice it is 
in general not easy to compare accurately several models using this technique. In 
fact a good validation by poles or sensitivity functions closeness will imply a good 
superposition of the time domain responses while the reciprocal is not always true. 


9.3 Other Methods for Identification in Closed Loop 


1. Using Open Loop Identification Techniques on Filtered Data 

The procedures try to approximate the methods presented in Section 9.2. 
Identification algorithms for open loop identification will process the plant 
input/output (u,v) data generated through feedback, but in general these data will 
be filtered. The filters are estimations of various sensitivity functions. These 
methods require the knowledge of the controller (Landau and Karimi 1997b, 
Landau and Karimi 2001b). 
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2. Direct identification 

One tries to identify the plant model from plant input/output data ignoring the 
effect of the feedeback (the external excitation being added either to the reference 
or to the controller output). Open loop identification algorithms are used and in 
particular those assuming the structure S3 for the noise (ARMAX), like extended 
least squares, output error with extended prediction model, etc. This approach can 
be viewed as a particular case of the previous one. 

The quality of the results is very variable. Despite the fact that the knowledge 
of the controller is not explicitly required, the results will strongly depend on the 
characteristics of the controller and the level of noise. As a general rule a “soft” 
controller which essentially tries to stabilize the operating point has to be used. 


3. Multi steps identification 
These methods have as objective on one hand to eliminate the need for the 
knowledge of the controller and on the other hand to eliminate the effect of the 
measurement noise (which is critical when using open loop type identification 
methods) (Van den Hof and Shrama 1993). 

To understand this approach it is necessary to refer to Figure 9.1. The 
implementation of this approach is done in several steps: 


1. The sensitivity function S,,=AS/P between the external excitation 


r,(t) and and the plant input u(t) is identified. 


2. One filters the external excitation r(t) through the estimated sensitivity 


function $ yp and one gets the instrumental variable u(t) which is not 


correlated with the noise 
i(t) = S,,(q-')r, O 


3. One uses the open loop output error identification method on u(t), y(t). 


9.4 Identification in Closed Loop: A Simulated Example 
The model used for simulation is 

AVO = BOQ” u(t) + C(q™ eC) 
with 


Alq!) =1-1.5q7!+0.7¢7; B(q')=q'+0.5q7; d=0 
Cq) =1+1.6g7' +0.9q7 
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where e(f) is a gaussian white noise sequence (zero mean, finite variance). 
The controller used (stored in the text file SIMUBF_RST.reg’) is defined by 


R(q7') = 0.8659 —1.2763q7' +0.5204q~ 
S(q7') =1- 0.62834! —0.3717q~ 
T(q')=0.11 


The excitation signal superposed to the reference is a PRBS generated by a shift 
register with N=7 and a frequency divider equal to 2 (forgs=0.5f,). A total of 1024 
samples are used. A high noise level has been voluntarily chosen (approximately 
20% noise to signal ratio). 

With 1024 data it is not possible to reach the asymptotic results; however the 
relative performance of the various methods are clearly emphasized. The external 
excitation, the plant input and the plant output are stored in the file 
SIMUBF4.ACQ’ and represented in Figure 9.5. 

Table 9.1 gives the identified parameters and the statistical validation results 
for the models obtained with various methods. The F-CLOE algorithm has 
provided the best model in terms of validation tests (the model identified with AF- 
CLOE has been used for computing the data filter). 

The last row of Table 9.1 gives the results with the best model (in terms of 
validation in closed loop) obtained by a direct open loop type identification using 
the plant input and output (and ignoring the feedback). The extended least squares 
method provided the best results. One can observe that this model does not pass the 
closed loop validation tests and the maximum value of the normalized cross- 
correlations is much larger than the values obtained with the methods dedicated to 
the identification in closed loop. 


Table 9.1. Models identified in closed loop 


Normalized cross- 
Closed loop : 
Method a a b bz error variance correlations 
l 2 l Š R(0) valid. threshhold: 
0.068 — |RN(max)| 
Nominal 
-1.5 0.7 1 0.5 
model 
AF-CLOE -1.47 | 0.6708 | 0.954 | 0.5218 2.63e-4 0.0097 
CLOE -1.4761 | 0.667 | 0.959 | 0.4858 0.00187 0.0284 
F-CLOE -1.4691 | 0.6703 | 0.9593 | 0.5152 4.51e-5 0.0085 
X-CLOE -1.4695 | 0.6524 | 0.942 | 0.3849 2.42e-4 0.083 
OL type 
identification | -1.423 | 0.6216 | 0.9408 | 0.4898 0.0025 0.0749 
(ELS) 


? Available from the web site: http//:landau-bookic.lag.ensieg.inpg fr 
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Figure 9.5. The external excitation, the plant input and output (file SIMUBF4.ACQ) for 
identification in closed loop (simulated example) 
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Figure 9.6. Frequency characteristics of various identified models 
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Figure 9.6 illustrates the frequency characteristics of the nominal model, the 
model identified with F-CLOE and the model identified with the extended least 
squares (ELS). 

It is the model identified by F-CLOE which is the closest to the nominal model (it 
is also the one which gives the best results for statistical validation in terms of 
uncorrelation). 

Augmenting the number of data, the models obtained with F-CLOE (or CLOE, 
AF-CLOE) will approach more and more the nominal model. See Landau and 
Karimi (1997b) and Landau et al. (1997). 


9.5 Identification in Closed Loop and Controller Re-Design (the 
Flexible Transmission)’ 


We will illustrate next the advantage of identification in closed loop for the 
improvement of the achieved control performances for the case of a flexible 
transmission (see also Chapters 7 and 8). The system has been described in Chapter 
7, Section 7.5.2 and in Chapter 8, Section 8.5. The block diagram of the system is 
recalled in Figure 9.7 where in addition the point of application of the external 
excitation in closed loop is indicated. 

The controller used is the R-S-T controller (B) designed in Chapter 8, Section 
8.5 (see Tables 8.7 and 8.8) and is stored in the text file flex_rst.reg. The external 
excitation (same PRBS used for open loop identification, the data are stored in the 
text file ibfs_sor.c) has been added to the output of the controller (see Figure 9.7). 

The model identified in closed loop with F-CLOE (the model identified with 
AF-CLOE has been used for computing the data filter) has provided the best 
validation results. The validation results for various models are given in Table 9.2 
and the parameters of the model considered for further use (F-CLOE) are 


Table 9.2. Statistical validation of the various identified models for the flexible transmission 


Normalized cross- 
Closed loop lati 
Method error variance corme ahons 
R(0) valid. threshhold: 0.136 

|RN(max)| 
AF-CLOE 0.01164 0.0498 
CLOE 0.01310 0.0998 
F-CLOE 0.01117 0.0147 
OL identified 0.01455 0.3821 

model 


3 This example has been worked out with the WinPIM® (Adaptech) identification software. 


392 Digital Control Systems 


d=2 
B(q™') = 0.42415q7' + 0.27288q~ 
Alq) =1-1.5782q7! +1.8181q ° —1.41982q° +0.84288q~* 


AXIS 


POSITION POSITION 
TRANSDUCER 


CONTROLLER R-S-T 
CONTROLLER 


Pref 


Figure 9.7. Closed loop identification scheme for the flexible transmission 


The statistical validation in closed loop (see Table 9.2) clearly indicates that the 
model identified in closed loop is better than the model identified in open loop. 
The frequency characteristics of the model identified in open loop (see Chapter 7, 
Section 7.5.2) and the model identified in closed loop (F-CLOE) are shown in 
Figure 9.8. One observes a difference in the values of the damping factors for the 
two vibration modes (the model identified in open loop is less damped). The 
conclusions drawn from statistical validation are confirmed also by the pole 
closeness validation between the identified and computed poles of the closed loop. 
In Figure 9.9 are represented the estimated “true” poles of the closed loop and the 
poles of the closed loop computed by using the model identified in open loop and 
the controller (B) designed in Section 8.5. The “true” poles are obtained by open 
loop type identification between the external excitation and the output of the closed 
loop system (using the same data as for identification of the plant model in closed 
loop). One observes first a qualitative difference since the computed poles 
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correspond to a pair of poles with the damping ¢=0.8 and w, =11.94 rad/s 


while the “true” dominant poles are an aperiodic pole at 0.763 and a pair of poles 
with the damping ¢ = 0.523 and @) =11.6rad/s. 


In Figure 9.10 the identified “true” poles of the closed loop and the closed loop 
poles computed using the model identified in closed loop (F-CLOE) and the same 
controller as before are shown. One observes an almost superposition of the 
dominant poles and of one pairs of auxiliary poles. Comparing Figures 9.9 and 
9.10 one can conclude that the model identified in closed loop gives a better 
description of the behavior of the closed loop. 
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Figure 9.8. Frequency characterisitics of the models of the flexible transmission identified 
in open loop (OL) and in closed loop(CL) 


The identified model of the “closed loop” whose poles are used in Figures 9.9 
and 9.10 has been obtained with the recursive maximum likelihood method 
(structure S3) using decreasing adaptation gain and an initialization horizon of 120 
samples. The size of the model results from the complexity of the model of the 
flexible transmission and of the controller which has been used 
(ny =8,ng =8,nç =8,d =0). 

The better quality of the plant model identified in closed loop is also confirmed 
by the time domain validation. Figures 9.11 and 9.12 provide comparisons of the 
simulated and achieved time response to a step on the reference. One observes a 
better coherence between the simulation and the real time response in Figure 9.12 
where the simulation uses the model identified in closed loop (F-CLOE). 
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Figure 9.9. Pole closeness validation: x-identified closed loop poles; o-closed loop poles 
computed with the model identified in open loop 
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Figure 9.10. Pole closeness validation: x-identified closed loop poles; o-closed loop poles 
computed with the model identified in closed loop 
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Flexible Transmission: Closed Loop Simulated Response vs Real Time Reponse 
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Figure 9.11. Time domain validation: (--) simulation using the model identified in open 
loop; (-) real time response 


Flexible Transmission: Closed Loop Simulated Response vs Real Time Reponse 
7 T T T T 7 T T T 


Amplitude (Volt) 


— Real time response 
-0.2 F --- Simulated response }] 
1 1 i i i 1 1 T T 
29 29.5 30 30.5 31 31.5 32 32.5 33 33.5 34 


Time (s) T = 50 ms) 


Figure 9.12. Time domain validation: (--) simulation using the model identified in closed 
loop; (-) real time response 
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Flexible Transmission: Closed Loop Simulated Response vs Closed Loop Real Time Reponse 
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Figure 9.13. Improvement of the performance with the controller designed using the model 
identified in closed loop: (--) simulation; (-) real time 


We will now illustrate that this improved model identified in closed loop allows 
designing a new controller that achieves better performance (in the sense that the 
achieved performance is closer to the specified performance). Keeping the same 
performance specifications as for the controller designed in Section 8.5 using the 
open loop identified model one gets a new controller (modulus margin 
AM = 0.537, delay margin At =0.075s ) whose performances are illustrated in 
Figure 9.13 (to be compared with Figure 9.11). 


9.6 Concluding Remarks 


We have examined in this chapter the important problem of identification of plant 
models in closed loop. Identification in closed loop should be considered in the 
following situations: 


1. Unstable processes or showing an important drift of the operating 
point 

2. A controller exits already 

3. Improvement of the closed loop system performance (controller re- 
tuning) 


The objective of the identification in closed loop is to obtain, for a given controller, 
a model of the plant allowing the best description of the behavior of the closed 
loop system. 

Identification in closed loop, provided that appropriate algorithms are used, 
allows to obtain better models for the controller design. 
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The closed loop output error identification methods (CLOE) are well suited for 
the identification of the plant models in closed loop operation. These methods 
require the knowledge of the controller. 

As for open loop identification, the model identified in closed loop should be 
validated. Several techniques for model validation in closed loop have been 
defined: 


e Statistical validation (uncorrelation test) 


e Pole closeness validation (evaluating the closeness of the true closed 
loop poles and those of the closed loop predictor) 

e Sensitivity functions closeness (evaluating the closeness of the true 
sensitivity functions and those of the closed loop predictor) 

e Time domain validation (comparison of real time response and of the 
simulated time response). 


The choice of the best model for re-design of the controller is done by comparing 
the validation results for all available models. It is useful to take also in account the 
model identified in open loop for this comparative validation (if it is available). 
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Landau I.D., Lozano R., M’Saad M. (1997) Adaptive Control, Chap. 9, Springer, 
London, UK. 

Karimi A., Landau I.D. (1998) Comparison of the closed loop identification 
methods in terms of the bias distribution, Systems and Control Letters, vol. 34, 
pp. 159-167. 

Landau I.D., Karimi A. (2001) Identification des modéles de procédé en boucle 
fermée, in Identification de systèmes, (I.D. Landau, A. Besancon-Voda, Eds), 
pp. 213-244, Hermès, Paris. 

Adaptech (1997b) WinPIM-BF — Software for closed loop identification, St. 
Martin d’ Heres, France. 

Adaptech (1999b) CLID® — Plant model identification in closed loop (toolbox for 
MATLAB‘), 4 rue de la Tour de l’Eau, St. Martin d’Héres, France. 
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Hall, London. 
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Reduction of Controller Complexity 


Controller complexity reduction is an issue in many applications. Techniques for 
controller complexity (order) reduction based on the estimation in closed loop of a 
reduced order controller will be presented. Methods for the validation of the 
estimated reduced order controllers are also presented. The use of these 
techniques is illustrated by their application to the complexity reduction of a 
controller for a flexible transmission. 


10.1 Introduction 


The complexity (order of the polynomials R and S) of the controllers designed on 
the basis of identified models depends upon: 


e The complexity of the identified model 
e The performance specifications 
e The robustness constraints 


The controller will have a minimum complexity equal to that of the plant model 
but as a consequence of performance specifications and robustness constraints this 
complexity increases (often up to the double of the size of the model, in terms of 
number of parameters, and in certain cases even more). 

In many applications the reduction of the controller complexity results from 
constraints on the computational resources (reduction of the number of additions 
and multiplications). These computational resources constraints come from various 
reasons: 


e Price in mass production (ex: cars) 

e Miniaturization and reduction of the energy consumption in certain 
embedded systems 

e High sampling frequency 
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One should also add that often in practice one may be interested in tuning an 
existing digital PID even if the order of the plant model to be controlled is higher 
than 2. 

Therefore one should ask the question: can we obtain a simpler controller with 
almost the same performance and robustness properties as the nominal one 
(designed on the basis of the plant model)? 

Let us recall first that the polynomial defining the closed loop poles results 
from the equation 


P(q')=A(q')Hs(q")S(q')+q BHRT )R(q') (10.1.1) 


where A, B, d correspond to the model of the plant to be controlled and Hp and 


Hs correspond to the fixed parts of the controller (introduced for performance and 


robustness reasons). The controller polynomials R(q~') and S (q) are given by 


RG) = HRR q) (10.1.2) 


Sq’) = Hs (q S'a) (10.1.3) 
and the corresponding minimal orders are 


ng =Nn4 +y, tny, —1 (10.1.4) 
Ng =Ngtdt+ny +ny, —1 (10.1.5) 


The concrete objective will be to reduce the order of ng and ns. 

The basic rule for developing procedures for controller complexity reduction is 
to search for controllers of reduced order which preserve as much as possible the 
properties of the closed loop. A direct simplification of the controller transfer 
function by traditional techniques (cancellation of poles and zeros which are close, 
approximations in the frequency domain, balanced reduction, etc.) without taking 
into account the properties of the closed loop leads in general to unsatisfactory 
results. 

Two approaches can be considered for the controller complexity reduction: 


1. Indirect Approach 
This approach is implemented in two steps: 


1. Reduction of the complexity of the model used for design, trying to 
preserve the essential characteristics of the model in the critical frequency 
regions for design. 

2. Design of the controller on the basis of the reduced model. 
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2. Direct Approach 
Search for a reduced order approximation of the nominal controller which 
preserves the properties of the closed loop. 

The indirect approach has a number of drawbacks: 


e Does not guarantee the complexity of the resulting controller (since the 
robustness specifications will be more severe when using reduced models). 

e The errors resulting from model reduction will propagate in the design of 
the controller. 


The direct approach seems the most appropriate for the reduction of the controllers 
complexity since the approximation is done in the last stage of the design and the 
resulting performance can be easily evaluated. It is this approach which will be 
developed in this chapter. 

Two criteria can be considered for direct reduction of the controller complexity: 


e Closed loop input matching (CLIM). In this case one would like that the 
control generated in closed loop by the reduced order controller be as close 
as possible to the control generated in closed loop by the nominal 
controller. 

e Closed loop output matching (CLOM). In this case one would like that the 
closed loop output obtained with the reduced order controller be as close 
as possible to the closed loop output obtained with the nominal controller. 


These two criteria are illustrated in Figure 10.1a,b where the nominal controller is 
denoted by K: 


R(q"') 
K= (10.1.6 
S(q™) i 


with 
Raq) =r tng +..4 on ™ G S(q')=14+5,q7' +...+ rq" (10.1.7) 
the reduced controller by K: 


Ay mi 
gadu) (10.1.8) 


with 


R =A tg atA a STES g HA g (10.19) 


and the plant model by G: 
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-d py ,-l 
ee A (10.1.10) 
Alq ) 


with 
Alq )=1+4q'+..+4,q°% 5 Baba +..+6,,9°% (10.1.11) 


For closed loop input matching (Figure 10.1a) one tries to find a reduced controller 


K which will minimize the difference between the input sensitivity function of the 
nominal simulated system 


a K 


up = (10.1.12) 
1+ KG 


computed with K and G and the input sensitivity function of the simulated 
system using the reduced controller 


minimize 


a) 


minimize 


Figure 10.1a,b. Criteria for controller complexity reduction: a tracking of the nominal 
control; b tracking of the nominal output 
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(10.1.13) 


computed with K and G. This is equivalent to the search of a reduced controller 


K which minimizes the error between the two loops (in the sense of a certain 
criterion) for a white noise type excitation (like PRBS). 

For the tracking of the nominal output (Figure 10.1b) the principle remains the 
same except that in this case one tries to minimize the difference between! 


F KĜ 


yr =- (10.1.14) 
i 1+ KG 


computed with K and G and the sensitivity function of the simulated system 
using the reduced controller 


a (10.1.15) 


computed with K and G. 

One can see immediately that in both cases the problem of finding a reduced 
order controller can be formulated as an identification in closed loop (see Chapter 
9) where the plant model is replaced by the reduced order controller to be 
estimated and the controller is replaced by the available estimated model of the 
plant (dual problem). 

The reduction procedures and the validation techniques for reduced order 
controllers to be presented next are available in the MATLAB” toolbox REDUC® 
(Adaptech 1999a) which can be downloaded from the book web site? . 

Design of a reduced order RST controller and of a digital PID for the flexible 
transmission presented in Section 7.5.4, using the reduction of a nominal RST 
controller (designed by pole placement), will illustrate the use of the techniques 
presented in this chapter. For the use of these techniques for controller reduction 
applied to an active suspension see (Landau et al. 2001). 


l Note that S’ „n — S.. =S. — S and therefore the tracking of the nominal output is equivalent to 
JF Dr yp yp 8 p q 


the minimization of the difference between the nominal and reduced output sensitivity functions. 
? http://landau-bookic.lag.ensieg.inpg.fr 
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10.2 Estimation of Reduced Order Controllers by Identification 
in Closed Loop 


10.2.1 Closed Loop Input Matching (CLIM) 


The principle is illustrated in Figure 10.2. 


Nominal closed loop (simulation) 


Reduced order 
controller 


Figure 10.2. Estimation of reduced order controllers by the method of closed loop input 
matching (CLIM). Use of simulated data 


The upper part represents the simulated nominal closed loop system. It is made 


up of the nominal controller ( K ) and the best identified plant model (G). This 
model should assure the best closeness behavior of the true closed loop system and 
the nominal simulated one. Identification of this plant model in closed loop can be 
considered if the nominal controller can be implemented. 


The lower part is made up of the estimated reduced order controller (K ) in 


feedback connection with the plant model (G) used in the nominal simulated 
system. The parameter adaptation algorithm (PAA) will try to find the best reduced 
order controller which will minimize the closed loop input error. The closed loop 
input error is the difference between the plant input generated by the nominal 
simulated closed loop system and the plant input generated by the simulated closed 
loop using the reduced order controller. 

The output of the nominal controller (plant input) is given by 


u(t +1) = -S (q uA + Rq elt +) (10.2.1) 
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with 
c(t +1) =r(t+)— y(t +1) (10.2.2) 
The a priori predicted output of the reduced order controller is given by 
n°(t+1)=-S"(t,q7!)a(t) + R(t,q )e(t +1) = A)’ A(t) (10.2.3) 


and the a posteriori predicted output is given by 


(+I) = Ot +)" GO (10.2.4) 
where 

40)" =[,0,..8,, 0.40.7, O] (10.2.5) 

H(i)" = La... i —ng +1), et +1, êE -np +D] (10.2.6) 


(t+) =r(t+D-S(t+D=r(t+)4+4 DIAO- B (q ult-d) (10.2.7) 


The closed loop input error is given by 


el (t+1) =u(t+1)—a°(t+1) (a priori) (10.2.8) 
Ec, (t+) =u(t +1) — u(t +1) (a posteriori) (10.2.9) 


and the parameter adaptation algorithm is expressed as 


Ot +1) = O(t) + FO (DE, (t +1) (10.2.10) 
FUG+D=A(OF +A, NOOO’ (10.2.11) 
0<A(<1 ; 0<4,(t)<2 ; F(0)>0 
e (t+1) 
l= cL 10.2.12 
fat +) 14+. 0)" FODA) 


Specific algorithms are obtained for different choices of the observation vector: 


e CLIM algorithm: ®(t) = (2) 
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. A(q"') 
e F-CLIM algorithm: ®(¢) = < O) 
algorı m Pq) 


where 
P(q')= Aq )S(q')+q “Bq )Rq') (10.2.13) 


The introduction of the filtering of ¢(¢) is motivated by the elimination of a 
sufficient condition for convergence which, in the case of the CLIM algorithm, 
depends on A(z!)/P(z). A detailed analysis of the properties of these 
algorithms can be found in Landau et al. (2001). 


Nominal closed loop (real time) 
V 


Reduced order 
controller 


Figure 10.3. Estimation of reduced order controllers using real data (CLIM) 


The estimation of reduced order controllers is also possible by using real time 
data (if the prototype of the nominal controller can be implemented on the real 
system). It is shown in Landau et al. (2001) that the use of real data allows one to 
take in account the error between the model and the true plant model in certain 
frequencies regions. 
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10.2.2 Closed Loop Output Matching (CLOM) 


The principle of this method is illustrated in Figure 10.4. 


Nominal closed loop (simulation) 


Reduced order 
controller 


Figure 10.4. Estimation of reduced order controllers by the method of closed loop output 
matching (CLOM). Use of simulated data 


Despite that the point where the external excitation is applied and the output 
variable is different with respect to Figure 10.1b, the transfer function between r(t) 
and u(t) is still the one given by Equation 10.1.14. This means that in the absence 
of disturbances (it is the case in simulation) u(f) generated by the upper part of the 
scheme given in Figure 10.4 is equal to (4) generated in Figure 10.1b. This allows 
one to use for closed loop output matching the CLIM (or F-CLIM) algorithm with 
the only difference that c(f) in Equation 10.2.1 is replaced by: 


x(t) = ĜA -u() (10.2.14) 


and accordingly c(t) in 10.2.3 and 10.2.6 is replaced by x(t): 


X(t) = G(q CORTO) (10.2.15) 


One should note that the order of the blocks in the upper part of Figure 10.4 can 
be interchanged (like the upper part of Figure 10.1b) without affecting the 
operation of the algorithm. This observation is of interest when real time data are 
used. 


10.2.3 Taking into Account the Fixed Parts of the Nominal Controller 


It is often required that the reduced order controller contains some of the fixed 
filters incorporated in the nominal controller (for example: integrator, opening of 
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the loop at 0.5f, or at other frequency). In order to do this one first factorizes the 
nominal controller under the form? 


K=K,K' (10.2.16) 
where K represents all the fixed parts that one would like to be also incorporated 
in the reduced order controller. 

The reduced order controller is factorized as 


K=K;,K' (10.2.17) 


One replaces in the CLIM algorithm the input ¢ of the controller K by the input to 
the controller K', denoted ĉ' , where ĉ' is given by 


E'A =K a DO (10.2.18) 


and in ¢(t), ĉ is replaced by c’. In the CLOM algorithm one replaces x(t) by 
x(t) given by 


OA =K DEDO- yO] (10.2.19) 


10.2.4 Re-Design of Polynomial T(q") 


Once a controller of reduced order is obtained and validated, one should re- 
compute the polynomial 7(q~') using the new polynomial defining the closed 
loop poles 


Pq?) = Aq) Sq") +g RRRA (10.2.20) 


10.3 Validation of Reduced Order Controllers 


Once a reduced order controller has been estimated, it should be validated before 
considering its implementation on the real system. 


3 If the nominal controller has unstable poles (which is certainly not desirable), they should be 
maintained as they are and therefore they should be included in K F- 
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10.3.1 The Case of Simulated Data 


It is assumed that the nominal controller stabilizes the nominal plant model (used 
for controller reduction). One implicitly assumes that the model uncertainties have 
been taken into account in the design of the nominal controller. 

The reduced order controller should satisfy the following conditions: 


e It stabilizes the nominal plant model. 

e The reduced sensitivity functions (computed with the reduced order 
controller) are close to the nominal sensitivity functions in the critical 
frequency regions for performance and robustness. In particular output and 
input sensitivity functions should be examined. 

e The generalized stability margin (see Appendix D) of the system using the 
reduced order controller should be close to the generalized stability margin 
of the nominal closed loop. This condition is expressed as 


b(K,G)-b(K,G\<e ; >0 


where b(K,Ĝ) and b(K,G) are the generalized stability margins 


corresponding to the nominal controller and to the reduced order controller 
and € is a small positive number. The closeness of the two stability 
margins allows maintaining the robustness properties of the initial design. 
The proximity or the nominal and reduced sensitivity functions can be judged 
by visual examination of their frequency characteristics. There exists however the 
possibility to make a numerical evaluation of this proximity by computing the 
Vinnicombe distance (v gap) between these transfer functions (see Appendix D). 
The Vinnicombe distance allows one with one number (between 0 and 1), to make 
a first evaluation of the proximity of the reduced and nominal sensitivity functions 
which is useful for the comparative evaluation of the various reduced order 
controllers. 


10.3.2 The Case of Real Data 


The use of real data (in the case where the prototype of the nominal controller can 
be implemented) allows completion of the validation done with simulated data. 

From Figure 10.3 it results that the objective is to test to what extent the 
simulated closed loop using the reduced order controller is close to the real closed 
loop system using the nominal controller. 

Initial information is provided by the variance of the residual closed loop input 
error. Subsequent information can be obtained by identifying the transfer function 
of the real closed loop system (between r, and u) and then comparing the 


frequency characteristics of this transfer function with that of the simulated closed 
loop system using the reduced order controller. In this case, using the Vinnicombe 
distance one can also evaluate rapidly the quality of various reduced order 
controllers. 
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10.4 Practical Aspects 


The quality of the resulting reduced order controller will depend upon the ability of 
the plant model in feedback with the nominal controller to reproduce the behavior 
of the real feedback system. 

If one has access to the real system and the nominal controller can be 
implemented, it is wise to identify a new plant model in closed loop and to validate 
comparatively in closed loop the various available models in order to select the 
best one. 

Note also that the same input/output data used for identification in closed loop 
can be in general used for controller reduction. For more details on these aspects 
see Landau and Karimi (2002). 

Once the best plant model is selected, the procedure for controller reduction is 
implemented (with simulated or real data). 

Using the methods described in this chapter, all the controllers with order of the 
polynomials R and S lower than the nominal one, can be estimated with only one 
set of data. Then, using the validation techniques, one select those reduced order 
controllers which assure a good approximation of the behavior of the nominal 
closed loop system. 


10.5 Control of a Flexible Transmission — Reduction of 
Controller Complexity 


The algorithms for reducing the controller complexity described in the previous 
sections will be applied to the flexible transmission already presented in Chapter 7, 
Section 7.5.4. On the basis of the fourth-order model identified for the flexible 
transmission (following an open loop identification procedure, see Section 7.5.4), a 
controller that guarantees the specified performances (standard robustness margins 
and regulation/tracking closed loop dynamics) has been computed by pole 
placement with the sensitivity functions shaping method in Chapter 8, Section 8.5. 

In this section we consider the RST controller obtained by requiring the same 
specifications (i.e. same assigned closed loop poles, controller fixed parts and 
robustness constraints) considered in Chapter 8, Section 8.5 (design C) but with the 
model identified in closed loop in Chapter 9, Section 9.5. It is characterized by the 
orders ng = ns = 5 for the polynomials R and S. We will refer to this controller as 
the nominal controller. 

The first objective of the controller reduction will be to find a good controller 
with orders for the polynomials R and S lower than the minimum orders which can 
be obtained in model based control design when only the integrator is imposed (np 
=n s> 4) š 

Consider now the following problem: is it possible to design a digital PID 
controller for the flexible transmission which will provide closed loop performance 
and robustness close to those provided by the nominal controller? The answer to 
this control design problem is not easy if one tries to tune directly the PID 
parameters. An effective solution can be obtained by reducing the complexity of 
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the full controller to ng = n 5 = 2 using the techniques presented in this chapter’. 
Therefore the second objective of controller reduction will be to tune a digital PID. 

The procedure for finding a controller of reduced complexity involves the 
following steps: 


1. Load the RST full controller, the flexible transmission model identified in 
closed loop and the excitation used to estimate the reduced order controller. 


2. Specify the fixed parts of the reduced controller together with the 
desired polynomials orders (ng and ns). 
3; Run an appropriate algorithm for the reduction of the controller 


complexity in closed loop (CLIM or CLOM). 
4. Validate the results in terms of comparison of the nominal and reduced: 
sensitivity functions and generalized stability margin. 


In this specific application, we will look for reduced order controllers with 


e nre=3,ns= 3 
e nr=2,ng= 2 (digital PID) 


and with the fixed parts: 
e H;= 1- q” (integrator), Hp = 1 


In Table 10.1 three reduced order controllers are considered. The reduced order 
RST controller Ķ; has a lower complexity than the minimum complexity which can 
be obtained in a model based control design and has been obtained using the 
CLOM reduction algorithm (simulated data). 

The orders of the polynomials R and S have been reduced from 5 to 3. 
Controllers K; and K; correspond to digital PID controllers and they have been 
obtained using CLOM (K;) and CLIM (K3) algorithms respectively. These reduced 
controllers are compared with the nominal controller (K,,). 

The values found for the Vinnicombe normalized distance’ (6,, rows 1 and 2) 
give a first indication of the proximity between the sensitivity functions computed 
with K, and those computed with K;, K and K;. As the first objective is to 
maintain the robustness properties and performance with respect to output external 


disturbances, the proximity of the reduced output sensitivity function Si, with 


respect to the nominal one is the main criterion for selecting the reduced order 
controller. Row 3 gives the generalized stability margin for each controller. The 
last two rows of the table give the frequency and the amplitude of the peak of the 
output sensitivity functions. 

Clearly controller K; provides very close performances with respect to the 
nominal one in terms of the gap on S,,, generalized stability margin and maximum 
of the output sensitivity function. 


4 More details about this example and the files to run the simulations can be found in Appendix G, 
Section G.6. 

> For definitions of the Vinnicombe normalized distance (v-gap) and the generalized stability margin 
see Appendix D.4. 
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Table 10.1. Comparison of the reduced order (PID and RST) controllers with the nominal 
controller (validation) 


K K K 
ii i 2 2 i 3 
Controller Np =5 ic a ng = ng = 
pa ny =2 ns =2 ns =3 
(CLOM) | (CLIM) | (CLOM) 
1 EES) - 0.6331 0.5280 0.1416 
2 BAS Sp) : 0.1443 0.2396 0.0111 
3 b(k) 0.2875 0.2490 0.2446 0.2854 
4 Max(S „) (dB) 5.13 6.31 6.35 5.25 
5 Fnac (HZ) 0.93 0.99 2.85 0.93 


The PID obtained with CLOM algorithm (K;) provides a smaller gap for the S,, 
than the one obtained using CLIM algorithm (K2) (this result was expected taking 
in account the criterion which is minimized — see Section 10.1). This is confirmed 
by a visual inspection of the output sensitivity frequency characteristics (see Figure 
10.5). In terms of closeness of nominal and reduced S,,, controller K; is slightly 
less good than K> (see Figure 10.6). 

Note that since in the reduced order controllers the opening of the loop at 0.5 f 
has not been imposed (in order to get a low order controller), there are important 
differences at 0.5 f. However the level of obtained S,,,is acceptable. 

The generalized stability margins (b(K)) for the reduced PID controllers are still 
close to that of K,,, and then the robustness properties will be only slightly changed. 
The magnitude of the peak of S,,, is almost the same for both PID controllers but 
for the K; controller the frequency is very close to that of K,. The peak for K; is 
only 0.31 dB over the standard 6 dB level required for robustness margin. 

In Figure 10.7 time domain simulations are given for comparing both tracking 
and regulation behavior of the reduced controllers considered in Table 10.1 with 
respect to the full RST controller (for a fair comparison with the PID, the full 
controller uses T = R(1) which corresponds to having same performance 
specifications in tracking and regulation). The K; controller also uses T = R(1). A 
PID2 structure (see Chapter 3, Section 3.2.4) has been used (with T = R(/)). In the 
case of the controller K3, the number of parameters for R and S has been reduced 
from 11 to 7 and in the case of the PID the reduction is from 11 to 5. 

The simulations show that controller K3 gives almost the same performances as 
the full controller and that K/ controller provides a better performance than K2 
controller. The performance of controller K/ is acceptable both in tracking and 
regulation (filtering the reference can further reduce the overshoot while providing 
the same time response as the full controller). 

Real time results are shown in Figure 10.8 and they confirm the results 
obtained in simulation. 
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Figure 10.5. Syp comparison between the reduced order (PID and RST) controllers and the 
full RST controller 
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Figure 10.6. Sup comparison between the reduced order (PID and RST) controllers and the 
full RST controller 
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Figure 10.8. Real time domain comparison between the reduced order (PID and RST) 
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10.6 Concluding Remarks 


In this chapter the bases of controller reduction have been presented together with 
a set of methods allowing one to effectively achieve controller order reduction. 
These methods are based on the use of closed loop identification techniques for 
estimating a reduced order controller. The objective is to find a reduced order 
controller such that the characteristics of the closed loop is as close as possible to 
the closed loop characteristics obtained with the nominal controller. 

Two specific objectives for controller reduction have been considered: 


e Closed loop input matching (CLIM) 
e Closed loop output matching (CLOM) 


The reduced order controller should be validated before its effective use. Dedicated 
validation techniques have been presented. 

In addition to the practical considerations which require reduction of the 
controller complexity, the use of the reduction techniques allows one to provide 
indirect answers to the following two important questions: 


e What is the optimal choice of the closed loop poles for a design by pole 
placement? 

e How to compute a reduced order controller (and in particular a digital PID) 
for a plant characterized by a high order dynamical model? 


10.7 Notes and References 


For basic references in controller reduction see: 


Anderson B.D.O., Liu Y. (1989) Controller reduction: concepts and approaches, 
IEEE Trans. on Automatic Control, vol. 34, no. 8, pp. 802-812. 

Anderson B.D.O. (1993) Controller reduction: moving from theory to practice, 
IEEE Control Magazine, vol. 13, pp. 16-25. 

The main references for the techniques presented in this chapter are: 

Landau I.D., Karimi A., Constantinescu A. (2001) Direct controller reduction by 
identification in closed loop, Automatica, vol. 37, no. 11, pp. 1689-1702. 

Adaptech (1999a) REDUC® — Controller order reduction by closed-loop 
identification (Toolbox for MATLAB"), Adaptech, 4 rue du Tour de 1’Eau, St. 
Martin d’ Heres, France 


Experimental results for the controller reduction applied to an active suspension 
can be found in the above references. 


Interaction between controller complexity reduction and closed loop 
identification is discussed in: 


Landau I.D., Karimi A. (2002) A unified approach to closed-loop plant 
identification and direct controller reduction, European J. of Control, vol. 8, 
no.6, pp 561-572. 
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A Brief Review of Some Results from Theory of Signals 
and Probability 


A.1 Some Fundamental Signals 


For the analysis of dynamic systems in the time domain the knowledge of some 
typical signals is necessary. 


Dirac Pulse 
It is a fundamental signal, since all the other signals are obtained by passing the 
Dirac pulse through an appropriate filter. The Dirac pulse is defined as the limit 
when A —> 0, of a pulse of unit surface having duration A and magnitude //A (see 
Figure A.1). For A —> 0, the magnitude goes towards infinity. 

The Dirac pulse is written as 


=lim—, O<t<A 
u(t) A>0 A 
=0, t<0,t>A 


Despite the fact that it is an abstract mathematical object, in many situations, the 
duration of a pulse applied to a system is very short compared to the time constants 
of the system, and it can be approximated by a Dirac pulse. The response of a 
system to a Dirac pulse is known as the impulse response. 

The discrete time equivalent of the Dirac pulse (also known as delta (6) 
function or Kronecker’s function) is 


@. t=0 
U 
‘ =0 t#0 
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| 


Dirac step ramp 
pulse 


Figure A.1. Dirac pulse, step and ramp signals 


Step 
The unit step is defined as follows: 


The step can be interpreted as the integral of the Dirac pulse. 
The discrete time step is defined in a similar way: 


O =0 <0 
“YNI t=0,1,2,3,.. 


The discrete time step can be obtained by the numerical integration of the discrete 
time Dirac pulse (6 function). 
The response of a system to a step is known as step response. 


Ramp 
The ramp is defined as follows: 
=0 t<0 
t 
A i t t20 


The ramp corresponds to the integral of the unit step or to the double integration of 
the Dirac pulse. In discrete time, the ramp is defined as 


(7? t<0 
ý =t t=0,1,2,3... 
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A.2 The z - transform 


Let f (k) a discrete time sequence defined for all k >0, (k = 0,1,2....). 
The z - transform of the sequence f(k) is defined by 


FOY z 


k=0 


If U(z) is the z -transform of the discrete time input sequence u(k) applied to a 
linear system andY(z) is the z- transform of the discrete time output 
sequence y(x) , one can define the pulse transfer function of a discrete time system 
as 


H(z) =Y(Z)/U(z) 


(for an equivalent definition see Chapter 2, Section 2.3.2). 
The z-transform of the discrete time Dirac pulse is 1. Therefore the pulsed 
transfer function H(z) of a linear discrete time system is equal to the z -transform 


of the output sequence when the input is a discrete time Dirac pulse. 


A.3 The Gauss Bell 


It is extremely important for a random variable (or for an ergodic stochastic 
process) to be able to specify what is the probability that this variable takes a value 
within a certain interval, or to specify what is the percentage of points, over a set of 
measurements of a random variable, which will be within a certain interval. If the 
random variable is gaussian (normal) or if the ergodic stochastic process is 
gaussian, this information is obtained from the measure of the area under the 
“Gauss bell” between the coordinates (values) x; and x2 (see Figure A.2). 


The expression for the “Gauss bell” is: 


e -wsxst0 (A-1) 


where, for the case of gaussian stochastic processes, MV is the expectation (or the 
mean value) 


MV = E{X(t)}= Jim Exo (A.2) 
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P(X < xo P(x4< X < x2) 


Figure A.2. Gauss bell 


and cis the standard deviation related to the variance of the stochastic process by 
the relationship 


N 
Var. = Ex) _uvy| = yl L LO - MV)? = 62 (A.3) 
œi t= 


From Equation A.1, it results that the “Gauss bell” shrinks around the mean value 
and its maximum will grow as the standard deviation odecreases. This is 
illustrated in Figure A.3. 

The probability that X takes a value between -oo and + o0 being equal to 1, it 
results that the total area under the “Gauss bell” is equal to 1 (or 100 %). 


fy j 


Figure A.3. Gauss bells for two different values of the standard deviation 


The probability that X takes a value < xg is equal to the area under the Gauss 
bell for -> <x < xg. This probability (denoted P) is a function which depends 
upon x. It is called probability distribution function. 


Fy (x)= P(X <x}=PEo<X<x} (A.4) 
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From Figure A.2, it results that 
P{x, < X < x3}= P{X <x,}— P(X < xı }= Fy (x2) - Fy (x1) (A.5) 


The derivative of the probability distribution function (if it exists), is called the 
probability density function of the random variable. 


POR (A.6) 


where 
dF y (x) = P{x < X <x+dx} 


F(x) being represented by the area under the “Gauss bell”, one concludes that the 
Gauss bell gives the probability density for gaussian random variables (or for 
ergodic guassian stochastic processes). 

From Equation A.6, it results that 


dF y (x)= P{x < X <x+dx}= fy (x)dx (A.7) 


which means that the probability that a random gaussian variable takes a value 
between x and x + dx is equal to fx(x) dx. 

Let us return now to the expression of the density of probability given by 
Equation A.1. If we will center the random variable (or the realization of the 
gaussian stochastic process) by subtracting the mean value, the Gauss bell will be 
centered around 0. In Figure A.4, a Gauss bell centered on 0 has been represented. 
The value of the area between various values of x has been indicated. This will 
give the percentage of points which will be found within these values (or the 
probability that a gaussian random variable takes a value within this interval). 

Some significant values concerning the Gauss bell are summarized in Table 
A.l. 


Table A.1. Percentage of points verifying | X | < a,a 2 O for an ergodic gaussian 
stochastic process 


a | o | isos | isso | 26 | 2110 | asic | so | 


weal E | = | [os To |» o 
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Figure A.4. Centered Gauss bell. Percentage of points located within two values of x 
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Design of RST Digital Controllers in the Time Domain 


B.1 Introduction 


In Chapter 3, the design of digital controllers in a deterministic environment has 
been discussed using exclusively the plant and controller representation by transfer 
functions (operators) in order to assign the poles of the closed loop. 

The same results can be obtained by designing the controllers in the time 
domain. The time domain approach emphasizes the predictive character of digital 
control by pole placement (or by other related control strategies presented in 
Chapter 3). This approach allows one on one hand to get a deeper understanding of 
the control of systems with delay since it clearly shows the presence of a predictor 
inside the controller and, on the other hand, it allows one to understand better the 
connection with the synthesis of digital controllers in a stochastic environment. 

An essential aspect in the design of digital controllers in the time domain is the 
synthesis of an (explicit or implicit) predictor for discrete time systems. Another 
important issue is that the resulting control u(t) should depend only upon the 
information available up to and including time t. 

If one takes the point of view of the controller design in the time domain, there 
are a number of specific control strategies known under the generic name model 
predictive control. Comparing the time domain control objectives for various 
model predictive control strategies, one can classify these strategies into two 
categories: 


1. One step ahead model predictive control 

In these strategies one computes a prediction of the plant output at t+d+J/ (d- 
integer delay of the plant) namely p(t+d+1)= f(u(t),u(t—I),...y(0), v(t—1),..) 
and one computes u(t) such that the control objectives expressed in terms of 
y(t+d +1) be satisfied. 


423 


424 Design of RST Digital Controllers in the Time Domain 


2. Long range model predictive control 

In these strategies the control objective is expressed in terms of future values of the 
output over a certain horizon and of a sequence of future control values. In order to 
solve this problem one need to compute the following predictions: 


yt+d+)= fo), y(t -),.u(t),u(t-1),.-) 
pt+d+ f= Fj, (VO, vit —1),..u(t),u(t—1),..)+ g (ue +)),..u(t+ 7-1); g, =0 


Note that predictions of the output beyond d+/ will depend on the future values of 
the control. The sequence of present and future values of the control i.e. u(t), 
u(t+1), ...u(t+j-1) is computed in order to satisfy the control objective. However 
only u(t) is applied to the plant and the procedure is restarted at t+1. This is known 
as the receding horizon procedure. 

All these strategies will lead to a linear controller as long as constraints on the 
values of the admissible control applied to the plant will not be considered. In all 
cases the resulting design can be interpreted as a pole placement. The closed loop 
poles will be defined by the design criterion used in time domain. The control 
strategies presented in Chapters 3 and 4 belong to the category of one step ahead 
predictive control (i.e.: there is a time domain control objective associated to each 
of these strategies). 

This appendix is organized as follows. Predictors for linear discrete time 
systems will be presented in Section B.1. The design of RST controllers in the time 
domain using one step ahead model predictive control strategies will be illustrated 
in Section B.2 for the tracking and regulation with independent objectives and pole 
placement. In Section B.3 it will be shown that the RST controller for a system 
with delay d can be decomposed in a d steps ahead predictor for the plant output 
and an RST controller for the plant without delay, using the predictor output 
instead of the measured output. Section B.4 will present briefly the long range 
model predictive control strategies which will be illustrated by the generalized 
predictive control strategy. 


B.2 Predictors for Discrete Time Systems 


The discrete-time model of a sampled-data system is described in the general case 
by 


Na 


npg 
WO) =-J a yt-)+) biut-d-i) (B.1) 


i=l i=l 


The linear discrete time model given in Equation B.1 is in fact a one step ahead 
predictor. Moving from t to t+/ its expression becomes 
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y(t+1)= S art +1-i)+ Sault +1-d-i) = A (qA +q B" (qua) 
i=l i=] 


= fly), y(t —1),... u(t), u(t —1),...] (B.2) 


where A (q"') and B (q) are given by Equations 2.3.22 and 2.3.24. One can 


observe that y(t+1) depends only on the values of y and u up to the instant t. 

An important problem is the prediction of the output y for t+1,t+2,... using 
the information (measures) available up to the instant ¢. This type of problem 
occurs for the control of systems with a discrete time delay d. In this case, we 
would like either to predict the value of the output with d+/ steps in advance, 
using only the information available at instant ¢, or to compute the value of u(t) 
allowing us to obtain a specified value of the output y at instant t+d+/. In fact we 
are looking for an expression of the form 


y(t+ j) = D+ j/t) = fly), v(t —I),...,.u(), u(t -1),...]; j<dtl (B.3) 


where (t+ j/t), denoted in a simplified notation by Ð(t+ j), represents the 
prediction of the output at the instant ¢ + j based on the knowledge of y and u up to 
and including ¢. 

In order to illustrate the concept and the synthesis of a predictor, first let 
consider an example. 


Example: Let 
y(t +1) =-a y(t) + but - 1) (B.4) 


which corresponds to a system with a discrete time delay d =1. 

We are interested in predicting the output value y(t+2) at instant ¢ on the basis 
of information available at instant ¢. In order to compute this predicted value, one 
expresses first the output y(t+2) as a function of the available information at instant 
t. From Equation B.4 one gets 


y(t + 2) =—ay y(t + 1) + bult) (B.5) 


which can also be written 


Aq” )y(t+2)=B (qu); A(q")=lt+aq'; B(q)=h (B.6) 


Note that y(t+2), given by Equation B.5, depends upon y(t+/) which is unknown at 
instant t. Therefore this expression does not allow a two steps ahead prediction. 
But y(t+1) can be replaced in Equation B.5 by its expression given by Equation 
B.4. One then gets 
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y(t + 2) = -a-a y(t) + bult- 1] + bult) = fov(t) + (14 e.g bult) 


: (B.7) 
= F(q')y(t)+ Eq B (quA) 


with 


F(q) = fo =a?; Eq) =1+eq" =1-aq7 (B.8) 


One observes that the right hand member of Equation B.7 depends only on the 
information available at instant ¢ and therefore the expression of the two steps 
ahead predictor will be given by 


P+ 2) = Fq YA + Eq” )B (qu) (B.9) 


where F(q’) and E(q') are given by Equation B.8. 


This technique of successive substitution of the one step ahead prediction can 
be generalized for any d, AandB. However, it is possible to directly find the 


polynomials Eq’) and F (a), Using Equation B.6 in Equation B.7 for 
replacing the term B'(q~')u(t) one gets 


y(t +2) = F(q"') + E(q"')A(q7') vt +2) 


F Haaa (B.10) 
=[Alq )Elq )+q “Fq Jy(t+2) 


In order that the two sides of Equation B.10 be equal, E(q™') and F (q7!) should 
verify the polynomial equation 


1= Aq DE +q? F(q’) (B.11) 


In other terms, this means that the coefficients of the polynomials Eq») and 


F (q') required for the computation of the predicted value j(¢+2) at instant ¢, 
are the solutions of the polynomial Equation B.11. This approach can be 
generalized for any A, B and d. 

In general, we look for the expression of a filtered prediction 


P(g) x(t +d+l)= priye athu] (B.12) 


where Pq’) is an asymptotically stable monic polynomial (the coefficient of 


power q? is 1). The discrete time system B.2 can be re-written in the form: 
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Alq Dyt +d +1) =B (q u(t) (B.13) 


We will search for an expression of the output having the form 


PAT yt +d +1) = F(q yA +E DB q uA) (B.14) 
where 
Pa j= fot hd terfa" (B.15) 
Eq hlte +. en q” (B.16) 


Using Equation B.13, Equation B.14 becomes: 


Pq')yt+d +N =[AG DE +g TFE) (B17) 
and therefore E (q') and F (q') are solutions of the polynomial equation 


PA= Aq DEG) +q F) (B.18) 


with 


np =max(n;-l,np-d-1); ng =d (B.19) 


in order to obtain minimum unique solution. 
Equation B.18 can also be expressed in matrix form 


Mx=p (B.20) 


where M is a lower triangular matrix of dimension (n, +d +1)x(n, +d +1), the 
vector X contains the coefficients of E(q') and F (q7!) and the vector 


p contains the coefficients of the polynomial P(q'). 
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[ nytd+l z] 
1 0 ; 0 
a 1 0 
ay a, 1 0 
: +d +1 
ag aq- š $ - a 1 na 
ady aq a, 1 
ad+2 Ady a, 0 ; 
: 0 
0 0 O a, 001 
`: —— 
L d+l ny | 
x berenn tied. 1 


np 


T 
P =|, Pi, P2-PN > PN aPN ad] 


(B.21) 


(B.22) 


In general n, Sng +d. If n, <n4 +d some of the components p; in B.22 will 


be null. 


The computation of E(q™) and F(q") requires uniquely the knowledge of 


d and A(q~'). For effective computations the functions: predisol.sci (Scilab) et 


predisol.m (MATLAB®)! can be used (see also Chapter 3, Section 3.4). 


The d+1 steps ahead predictor will be given by 
PQ )H(t+d +1) =F y(t) + EB GT u(t) 


and the prediction error defined by 


elt+1)= y(t +1)- (t+!) 
will satisfy the equation 


P(q')e(t +d +1) =0 


1 To be downloaded from the book web site. 


(B.23) 


(B.24) 


(B.25) 
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which is obtained by subtracting Equation B.23 from Equation B.14. In other 
words, the prediction error will tend towards zero for any initial prediction error 


provided that P(q~') is asymptotically stable. For P(q~')=1the prediction error 
becomes zero at t+d +1. 


B.3 One Step Ahead Model Predictive Control 


Tracking and Regulation with Independent Objectives 
Since an expression of the predicted output with d + 1 steps ahead is available, it is 
now possible to compute the control u(t) allowing us to obtain at t+d +1 an 
output y(t+d+1)= y(t +d+l1) where y(t +d+1) is the desired output at 
t+d+l. 

Let us considers the example of Equation B.4. The condition 
y(t+2)= y (t+ 2) can be expressed using Equations B.7 and B.8 as 


yit +2)= a; y(t) a,bu(t — 1) + byu(t) 
from which one gets 


_ y (t4+2)-a; y(t) + adult -1) 
b 


u(t) 


In the general case one would like to obtain 
P(q"')y(t+d +1) = P(q"')y (t+d +1) (B.26) 


and one gets from Equation B.14: 


P(q"')y (t+d +1) =F(q")y() + E(q")B (qult) (B.27) 


and accordingly 


Pig) >» F(q') 
(t) = ———————__p (t+ d +1) --———_ B.28 
EGBG) E@ BG) me 


Introducing the notations 
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Rq')=F(q') (B.29) 
S(q')=b, +q'S (q')=E(q"')B (q"') (B.30) 
T(q) = Pq") (B31) 


Equation B.26 becomes 


SMO =T )y +d +) -RAVO (B.32) 
that corresponds to an RST digital controller given in Chapter 3, Section 3.4. 


Since in the general case u(t) has been computed such that Equation B.27 be 
satisfied at each sampling instant, it results from Equations B.24 and B.27 that 


P(S) = Pq" ')y (t+) (B.33) 


and taking in account the definition of ¢(¢+1) given in Equation B.24 as well as 
Equation B.25, one gets 


P(q')[p(tt+d +l)-y (t+d4+1)]=0 , Yt>0 (B.34) 
which can be considered as the time domain objective of the tracking and 
regulation with independent objectives. 

To summarize: the problem of the design of the control law is to compute 


u(t) = A (vt), v(t — V,...,u(t — u(t — 2),...) (B.35) 


such that Equation B.34 be satisfied (with P(g'), an asymptotically stable 
polynomial). 
The solution is obtained in two stages: 


Stage I: A d+] step ahead predictor of the output is designed such that the 
prediction error satisfies 


P(q')e(t+d+1)=0 
Stage IT: Compute u(t) such that: 
P(q')p(t+d +1) = P(q')y (t+d+1) , Vt>0 


Note that the same result is obtained if the criterion of Equation B.35 is replaced 
by the one step ahead quadratic criterion 
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* 2. 
minJ(t +d +1)= P(qg)|p(e+a +l)-y (t+d +p} 
u(t) 


Pole Placement 
To get the pole placement, the time domain objective B.35 is replaced by 


P(q)Lyt + d +1) — BB*(q"')y*(t+d+D]=0 Vt>0 (B.36) 


with B= Ve (1) and imposing the restriction that B *(q_') should not appear in 


the denominator of the controller. This restriction requires a different structure for 
the output predictor to be considered: 


PQ ')y(ttd+N=BeQ RG y+ Bq Sq ut) (B37) 
Using Equation B.13, Equation B.37 becomes 

P(q')y(t+d +l) =[AS +q "B * Rl y(t +d +1) (B.38) 
and therefore polynomials S and R are solutions of the polynomial equation 


P= Aq DS +q 'B*(q")R(q"') (B.39) 


which is exactly the pole placement equation discussed in Chapter 3, Section 3.3. 
Introducing Equation B.38 into Equation B.36 and taking into account Equation 
B.13 one gets the RST controller of Equation B.32 where S and R are solutions of 


Equation B.39 and T(q7') = 6P(q"'). 


B.4 An Interpretation of the Control of Systems with Delay 


We will show next that the RST controller for a system with a delay d can be 
decomposed in a d step ahead predictor for the plant output and an RST controller 
for the system without delay which uses instead of the measured output, the output 
of the predictor. 

Consider first a system without delay (d = 0) characterized by the discrete time 
model 


ACTI y+) = Bg!) u(t) (B.40) 


The desired closed loop poles are defined by a polynomial P(g~/). Using the pole 
placement, the controller equation is 
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T(q_')y*(t+1)-Ry(q_') VÀ 


u(t) = = (B.41) 
Sod ') 
where Sọ (q-/) and Ro (q-!) are the solution of the polynomial equation 
Aq!) So(a) + q” Beg!) Rog!) = P(g) (B.42) 


and T(q~') = Pq). 
The transfer operator between the reference trajectory and the output has the 
expression 


“ly -l =] -ipf -1 -1 

E T B* T B* 

ma -— Ta Ju ` J aoe (q J3 (4) (B43) 
Alq )So(q )+q B* Ra ) Pq) 

Consider now a system with an integer delay d characterized by 


A(q t!) y(t+d+1) = B*(q}) u(t) (B.44) 


The desired closed loop poles are defined by the same polynomial P(q~/) as above. 
Using the pole placement, the controller equation will be 


T(q y *(t+d +1) -R (qO 


u(t) = = (B.45) 
Salq D 
where RAT’ et S PCH ) are solutions of the polynomial equation 
ATI) SATI + g% BHC) RATI) = P(g) (B.46) 


The transfer operator between the reference trajectory and the output has the 
expression 


qT BG) 7 
Alq Sa lq +q 'B*(q"')Ra(q') P 


Hq) = (B.47) 


We will show next that this controller can be equivalently represented as shown in 
Figure B.la. The controller of Equation B.47 is replaced by the controller for the 
system without delay given by Equation B.41 which uses instead of the measured 
output, the d step ahead predicted output given by 


Ht+d/t)=F(q"')y(t)+q'E(q")B (q UA) (B.48) 
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where E(q™!) and F(q”) are solutions of the polynomial equation (for prediction)” 


AÌ Ee) +q! F(q) =1 (B.49) 


Using the predictor Equation B.48, the scheme given in Figure B.la takes the 
equivalent form shown in Figure B.1b. 


y*(t+d+1) u(t) y(t) 


T=P 


i 
I 
a) 5 
0 l 
f | Poo e 
n A E eee EE acd I 
y(t+d)It d steps ahead predictor 
y*(t+d+1) u(t) y(t) 
+ 
1 -d-1 B* 
— 7T =P 
i Sotq B*ERo B 
b) 
RF + 


Figure B.1a,b. Equivalent representation of RST digital controllers for systems with delay 


The control signal is given by Equation B.41 in which y(t) is replaced by the 
predicted output p(t + d/t), which leads to 


Sog UA =T y * +D -Rq t+d/d) (B.50) 


Introducing in Equation B.50 the expression of (t + d/t) given by Equation B.48 
one gets 


[So(q')+q El B * (qR IUA =T y * +d +D- RIDETO 


? If additional auxiliary poles are considered, they can be interpreted as poles of the predictor. In this 
case in Equation B.49, the right hand side is replaced by a polynomial defining the auxiliary poles. See 
Landau et al. (1997). 
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which corresponds to the controller shown in Figure B.3b. If one computes now 
from Figure B.1b, the transfer operator between the reference trajectory and the 
output one gets 


H, = q“'T(q')B*(q"') 
A(q')So(q')+q°'B*(q )Ro(q AG DEQ +94 FD] 
q 'T(q')B*(q') _q 'T(q')B*(q') 
A(q"')So(q')+q°'B*(q")Ro(q_') P(q') 


since A(q!) E(q!) + 4 F(q)= 1 and Aq!) So (q!) + q? Bg) Rog)= PG!) 
(see Equations B.49 and B.42). 

The same interpretation is obtained for all the control strategies presented in 
Chapter 3. 


B.5 Long Range Model Predictive Control 


The subject long range predictive control is discussed in a number of books 
(Camacho and Bordons 2004; Macejowski 2001). We will consider here the 
control strategy called generalized predictive control (Clarke and Mothadi 1987). 
For a detailed presentation see Landau et al. (1997). 

The generalized predictive control belongs to the class of long range predictive 
control. The control objective is the minimization of a quadratic criterion involving 
future inputs and outputs. The minimization is done in a receding horizon sense, 
i.e. one computes a sequence of control signals in the future, but only the first one 
is applied and the optimization procedure is re-started at the next step. Indeed the 
resulting control law is stationary and the controller takes the form of a linear 
digital RST controller. With an appropriate formulation of the performance 
criterion, generalized predictive control can be interpreted as a generalization of 
the various one step ahead control strategies. However the generalized predictive 
control can be also viewed as a way of assigning the desired closed loop poles 
starting from a time domain performance criterion. 

In order to make a direct connection with pole placement it is convenient to 
make the following change of variables: 


e (t+ j)=y(t+ j)- BB*(q)y*(t4 J) (B.51) 
e, (t+ j)=u(t+ j)- BA(q )y*(t+ j+dt) (B.52) 


where e, and e, define a new output and a new input respectively. They are related 
by 


A(q"'Je,(t +d +1) =B*(q"')e, (0) (B.53) 
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One considers as control objective the minimization of the quadratic criterion 


hy 
Jh, hoh) = X fe a+ pP +ale,(e+ ja) Ff: A>0 (B.54) 
ae 


i 


where 


e h,- prediction horizon 
e h.—control horizon 
e h;— initial horizon (2d +1) 


The criterion of Equation B.54 should be minimized in a receding horizon sense 
with respect to the vector of control signals 


El (t+h,-l=[e,(d),e,(t+D,...e,(t+4, —1)] (B.55) 
subject to the constraint: 


e,(tti)=0 h <i<h, 


The initial horizon A; is taken equal or larger than the delay d+/. The prediction 
horizon A, is usually taken close to the time response of the system. The control 
horizon h, will define the complexity of the optimization procedure and the 
objective is to take it as small as possible. However instabilities may occur for too 


short control horizons. If h,,h, >% one gets the infinite horizon quadratic 


criterion and this is discussed in Appendix C. 
It is important to note that for h, =h,;=d+1,h,=1 one step ahead control 


strategies will be obtained. If in addition A=0 one obtains the pole placement. For a 
more detailed discussion see Landau et al. (1997). 
The minimization of the criterion of EquationB.54 involves two steps: 


1. Computation of the future values of e, (t+ j) for j <[h;,h,] as 
e (t+ j)= JIE, (t+h, -11+ êt + j/t) (B.56) 
where ê (t+ j/t) is the prediction based on the available information 
up to the instant t: 


ê+ j/t)= fle, (t), e, (t-D),...2, (t-1),€, (t-2),..] 
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2. Minimization of the criterion of Equation B.54 with respect to 
E,(t+h.-1). 
We will give now the details of these two steps for the computation of the control 
law. 


Step 1: Computation of the Future Values of e,(t + j) 
Using the polynomial equation 


Py = AE, +q/F, (B.57) 


with deg E; = j—land deg F, = max(np, — j,n4—1), one can express the filtered 
values of e, (t+), which are used in the criterion of Equation B.54, as follows 


(taking also in account Equation B.53): 


Pye, (t+ j) =E,B*e,(t+ j—-d-1)+ Fye,(t) (B.58) 


The effect of using a filtered prediction equation is that the resulting closed loop 
characteristic polynomial will contain a factor equal to the Pp polynomial. In other 
words one can assign by this choice a number of poles of the closed loop. 

To get the desired form of the prediction indicated in Equation B.56 one should 
use a second polynomial equation 


B*E, =P G; atq Ha (B.59) 
where 


degG;_4 =j-d-l 
deg B*E, =ngs—j-1 
deg H j_qg =Nng+-d-1 


The polynomials G;.4and H;.4 will have the form 


= —~j-d-— 
Gig = g} + 219 Tht aad J i (B.60) 
Hyg =he i +h) ag Ah ga (B.61) 


Using Equation B.59, the filtered prediction e,(¢+ j) given in Equation B.58 can 


be written 
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Poey(t +f) = PyG aeut + J-d-1) +A, ge, ¢-)+ FeO (B.62) 
Passing this expression through the transfer operator 1/ P) and denoting 
Prev(t + j/t)=H ;_ge,(t-l) + Fe, (0) (B.63) 
one gets 
e (t+ j)=G,_ge,(t+ j-d -l) +E (t+ j/t) (B.64) 


with the important remark that the term G,_ge,(¢+j—d-—1) will contain 


e, (t),e, (t+ 1),...e, (t+ j -d—-1), i.e. only future values of e, since j 2h, >d +13. 


Step 2 Minimization of the Criterion 
Introducing the notation 


Ey =[e,¢+h;),...e,(¢+h,)] (B.65) 
E; =le, (t)y€, (t+ h, —1)] (B.66) 


the criterion of Equation B.54 takes the form: 
J=E E, +E, E, (B.67) 


Taking in account the expression of e,(¢+/) given in Equation B.64 and 


introducing the notation 
oT _ ps0 z0 
Ey =[€,( +h, /t),..2,@+ A, /t)] (B.68) 
one can re-write Equation B.65 using Equations B.64 and B.68 as 
E, =GE,+ Ey (B.69) 


where G is a matrix formed with the coefficients of the polynomials Gj_, : 


3 At instant t, e, (t) is available before the computation of e, (£t) . 
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En So 0 0 | 
Sh,-d 81 & 0 0 
G= : S (B.70) 
Eia: a ee e Zo 
[Emdi ee Shy het | 


The criterion of Equation B.67 will take the form 


J (thy heh) = [GE,, + Ey i [GE,, +E) 1+ AE] E (B.71) 


Minimization of this criterion is obtained by searching for E, assuring ——=0, 
u 


which yields 


=-(G7G+Al, J'G"ES (B.72) 


E, opt” 


This formula clearly indicates that the problem always has a solution provided that 
A>0 (however the stability of the resulting closed loop has to be checked). 

For an effective implementation of the control one only needs the first 
component of E„, namely e,(t), and, as a consequence, only the first row of the 


matrix [G’G+ AI he | 'G’ is of interest. Therefore one obtains 


eult) = 7n; Vrp Ey (B.73) 


where 7; are the coefficients of the first row of [G’G+ Aln, Fe ; 
Using Equations B.63, Equation B.73 can be further rewritten as: 


Pre, (®©) = -Poln np Ey 


j=hp j=hp 
== 2 yH j-a e,(t -l- 2 7 F; e,(t) 
JF Jah; 
or as 
j=h, j=h, 
Pp +q” Ha le,(t)+ F, le, = 
DTt4 2r j-d Q) 2r j y(t) (B.74) 


= Sge, +R e, (t) = 0 
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where the polynomials S and R correspond to 


j=hp 
Sq’) = Paq) -a z yH jalg") (B.75) 
Jahi 
3 j=hp A 
R(q )= 2 VF iq) (B.76) 
J=N; 


Using now the expressions for e,(t) and e,(t) given by Equations B.51 and B.52, 
one gets the expression of the RST control law: 


S(T u(t) =T(q"')y*(t+d +) - RQ”) yO) (B.77) 
where 
T(q"') = BP = BIAS +q“ 1B R] (B.78) 


and P defines the resulting closed loop poles corresponding to the minimization of 
the criterion of Equation B.54. The controller structure is the same as for the pole 
placement (see Chapter 3, Section 3.3). It can be shown that the resulting closed 
loop poles are (Landau et al. 1997) 


PQ") =Pp(q') Parca) 


where: 


hp . 
Popel )=AQ') +g È 7 |B*(q"')-Aq')G;-a(q')I 
J=hi 


and Ppis the polynomial defining the poles of the predictor. 

If Pp is chosen such that it defines the dominant poles of the closed loop, the 
poles introduced by the minimization of the criterion of Equation B.54 can be 
interpreted as auxiliary poles. However if Pp=/, then the poles of the closed loop 
will be exclusively defined by the minimization of the criterion of Equation B.54. 
The values of the closed loop poles will depend of how A, A; A. and h, will be 
selected. 
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C 


State-Space Approach for the Design of RST 
Controllers 


C.1 State-Space Design 


In Chapter 3 we discussed the pole placement design using a two degrees of 
freedom polynomial RST controller. The assignment of the closed loop poles is a 
problem that can be solved also taking a state-space formulation of the problem. 

The same type of controller is obtained by designing the controller using a 
state-space approach. The state-space approach will emphasize the interpretation of 
the RST controller as a state estimator followed by a state feedback using the 
estimated state. This approach also provides an interesting interpretation for the 
dominant and auxiliary closed loop poles. Furthermore the relation for passing 
from a controller designed in state-space for SISO systems to a polynomial 
controller will be provided. This result can be used for transforming state-space 
controllers designed by different approaches in a polynomial form. 

A detailed discussion of regulation by state feedback is beyond the purposes of 
this book. The reader can find exhaustive descriptions of this technique in (Phillips 
and Nagel 1995; Franklin et al. 2000). Here we just recall some fundamental facts. 
We will consider in this appendix the state space solutions for pole placement and 
linear quadratic control. 

Let consider the controllable canonical space state representation of a single 
input single output discrete time model characterized by the transfer operator 


B(q"')/ A(q')! (it is assumed that A(q™') and B(q~')do not have common 
factors, i.e. the system is both controllable and observable) 


' The delay is included in the B polynomial (i.e. the first coefficients b; of B will be null up to the value 
d of the integer delay). 
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Qj ss: wae =a 
1 0 
x.(t+l) = é x(t) + mG) 
1 0 0 
(C.1) 
yt) = [bh a B]e@O 


Suppose that the desired closed loop characteristic polynomial is specified by 
P(z')=14 pz} +...4p,z" (C.2) 


If the full state is available, the control law that allows to obtain the specified 
closed loop poles is 


u(t)=—kx.(t)+y (t+d) (C.3) 
where 
k=[k, k ... ky] (C.4) 


is a state-space feedback gain matrix (which has to be computed) and y*(t) is the 
external reference. 

The closed loop system in the state-space form is found by introducing 
Equation C.3 in Equation C.1: 


(a-k) de oa (a, —k,) 


1 O| x 
x.(t+l) = 3 x(t) + . |y (+d) 


1 0 0 


Ax,(t)+by (t+d) 


(C.5) 


The characteristic polynomial of the closed loop system thus is 


P,(z")=1+(a,+h)z +...+(a, +k,)z™” (C.6) 
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and it can be easily observed that, comparing Equations C.2 and C.6, the closed 
loop poles can be assigned with an appropriate choice of vector k (k; = p; —a;). 


If the full state x.(f) is not directly available a state observer will be 
implemented. We consider the canonical observable form of the plant model 


x (t+1) 


y(t) 


-q 1 


Tan 


II 


fo + 


bi 


u(t) 


(C.7) 


fl 0... oO 


An estimate of the state £, (t) can be provided by the so-called current estimator 


(see Phillips and Nagel 1995; Franklin et al. 2000), where a description of the 
standard prediction estimator is also provided), that is described by the following 


expressions: 
-q 1 | b 
x (t+) = ot) + 
=a, 0 Lb, 
l 
X (t+) = x,(t+) + 
Un 


| D+- 


(C.8) 


olz (t+1)] 


where x,(¢+1)is the a priori state estimation at time ¢+/, on the basis of the 


signals acquired at time ¢, and x,(t+1) is the estimation depending on the current 


measurement at time ¢+/. The coefficients /; are the observer gains acting on the 
error between the measured output and the a priori predicted output. 
Consider now the state estimation error e(t) = x, (t)- £, (£). 


Then 


e(t+1) 


x, (t+) 
Ax, (t) 
[b —Icb]u(t) 
[A-IcA]Ix() - 2,0] 


x,(¢+ 1) 
bu(t) — [A-IcA]x,(t) 
Ic[Ax, (t) + bu(t)] 
[A —IcA]e(t) 
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where 
-4 1 [b 
i= nosli 
1 : 
“ån 0 |b, 
ry 
c = [I J] a 
Un 


The state estimation error will converge asymptotically to zero if the matrix 
[A-—IcA] is asymptotically stable. This property will be defined by the roots of the 


characteristic equation 


z™I-A+led|=0 >|z|<1 


and the estimation error can be made to converge to zero with a desired dynamics. 
Once the desired dynamics is imposed the parameters of / can be computed 


accordingly. 


Assuming that the desired estimator dynamics is defined by the polynomial 


= -1 = 
Po(z D =1+ prz +... + DayZ ý 


then the coefficients /; are given by 


i cA] [0 
L cA“ 0 
1=| ? | =P,(A) i 
1 cA” 1 


n 


where P;(A) is a matrix polynomial whose coefficients are those of Pz(z): 


P,(A) =A" + pg A”? +...+ pp I 


Note that, if the new state representation 


., LO 
CL e(t) 


(C.9) 
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is considered, the closed loop system matrix is expressed by 


x(t+1))_ (A-bk +bk \( x(t) 
e(t+l)} | 0 A-IcA)\e(t) 
from which it results that the closed loop poles are a combination of the estimator 


poles and the control poles (specified by Equations C.2 and C.9 respectively). 
The characteristic equation of the closed loop system is thus defined by 


zT-A +IeAle-'7 — A+bk|=P.(z7')P,(z7!) =0 (C.10) 


We remark the rapprochement between the RST pole-placement and the state- 
space approach in terms of the assigned closed loop poles. In the RST pole 
placement we have specified the closed loop poles as a combination of dominant 
poles (slow poles) and auxiliary poles (fast poles). In the state-space pole 
placement the control poles (defined by Equation C.2) correspond to the dominant 
poles while the estimator poles (defined by Equation C.8) play the role of the 
auxiliary poles. Note however that one could choose the dominant poles as the 
estimator poles and the auxiliary poles as control poles (this is the case in the 
predictive control approach). 

We recall that in Chapter 3 several techniques for selecting auxiliary poles have 
been proposed in order to obtain a robust control design. One notes that the choice 
of the estimator poles could be not immediate if robustness considerations are not 
taken into account. 

Thus, the full controller will be given by the current estimator and the state 
feedback as shown in Figure C.1. 

The corresponding pulse transfer function of the digital controller resulting 
from the state-space approach is given by 


U(z") 
Yo 


K(z)=- =e - A+icA+bk-lcbk] 1 (C.11) 
It is now straightforward to show the equivalence between the digital controller 
K(q_') resulting from the state-space approach and the digital controller 


R(q"')/S(q~') obtained by pole placement design in polynomial form, when 
imposing the same closed loop dynamics. 
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Com pensator 


Figure C.1. State-space control scheme 


Consider the transfer function of the RS controller 


-1 =n 
RD tmz +...%,7 R 
ul 2 e (C.12) 
Sq) SoZ +...8,,2 ° 


The numerator and the denominator of the RS controller transfer function are 


Re) = 2K adj kI- At cA + bk —leb kL (C.13) 
S(z)= |27- A+ led + bk — Icbk| 


Introduction of the Internal Model 

Note that with the state-space design no special compensation of specific classes of 
disturbances (for example constant or sinusoidal disturbances) is done unless the 
pole placement problem in state-space is reformulated. 

The basic idea in order to introduce the internal model of the disturbance in the 
controller is to augment the state-space representation of the model by adding the 
internal model and then apply the procedure presented above. If, for example, a 
compensation for constant disturbances is desired, then an integral action is 
required. This can be accomplished by augmenting the model of the plant with an 
integrator and recalculating the feedback control gains for the augmented state. Of 
course in the implementation the internal model will appear in the controller. 

In the same way, for a generic class of disturbances modeled by a system 
matrix Áa, the augmented system matrix should contain the model of the 
disturbances that is 


A Cy 
Any = 
j 0 Aq 


State-Space Approach for the Design of RST Controllers 447 


where C, is the matrix that describes how the disturbance is injected into the 
system. 


Taking into Account Tracking Performance Specifications 

So far we have discussed the regulation problem. A common control problem has 
specifications that also involve tracking properties. A controller that takes into 
account both regulation and tracking requirements generally has a two degrees of 
freedom structure (feedback and feedforward compensator). 


Feedforward 
Compensator 


Feedback 
Compensator 


Figure C.2. Two degrees of freedom control scheme 


The control signal generated by the state feedback is designed in order to have a 
closed loop system with desired regulation and robustness properties. The 
feedforward compensator is designed in order to match the desired tracking 
performances. 

In order to obtain the standard RST control law (Equation 2.5.9, which takes 
into account both tracking and regulation performances) starting from a state space 
representation, one considers the plant model described by 


Alq y(t +d+1)=B* (qult) (C.14) 
and the following variable transformation: 


B(q"') 
B(1) 


e,(t)=y(@)- y*(t) 


(C.15) 


= 
e O=O- AE yt ed +) 


Left multiplying the first row of Equation C.15 with A(q’) and considering an 
instant t+d+/ we obtain the following relation (by taking in account Equation 
C.14): 


Aq De, t+d +l) =B*(q e,t) (C.16) 
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Note that e, and e, are related to each other by the same transfer operator as the 
plant model. 

The state-space representation in observable form of the system described by 
Equation C.16 is: 


-q 1 b 
E O + e,(t) =Ax(t)+b'e,(t) 
~an 0 b, 
e() = fl 0 olke =cx(t) 
(C.17) 
where 


b,=0;0<i<d; b,,g=b,;15i<n, 


If we apply to the system of Equation C.14 both state-feedback and observer 
Equations C.3 and C.8 an RS controller of the form of Equation C.12 is found. 
The control law for the system of Equation C.14 becomes: 


S(q')e,(t) + R(q Je, (t) = 0 (C.18) 


We now rewrite this equation in the initial variables u(t), y(t) and y*(t). The control 
law is thus 


-1 z -1 -1 
su =—REg) (+) AEE 2 ye¢4d+1s 2G RO) ae 


=-R(q")y(t)+T(q)y*(t+d +1) 


(C.19) 


where 


= [Aa DS+ BR") Pq") (C.20) 


-1 
Pa BO BO 
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Equation C.19 represents the two degrees of freedom RST control law, as obtained 
in Chapter 3, Section 3.3. 


C.2 Linear Quadratic Control 


Consider again the system of Equation C.14. The objective is to find an admissible 
control u(t) which minimizes the following quadratic criterion: 


a. ee 
J(Œ,T)= lim a zbe +j)-y* t+)? 
—> 0 j= 


+ Alu(t + j-1+d)P 


(C.21) 


However in order to obtain directly a two degrees of freedom controller it is useful 
to use again the change of variables given in Equation C.15 and to consider the 
criterion: 


_ 1X 5 
J(t,T)= lim — y e (t+j 
or) fim Dee 2 (C.22) 
+Ale (t+ j-1+d)P;  A>0 


The criterion of Equation C.22, with the state-space representation of Equation 
C.17, takes the form: 


T 
J(t,T)= lim S + f)CC' x(t + j)+ Ae? (t+ j) (C.23) 
j=l 


Assuming that the state x(t) is measurable, the optimal control law e,(¢) is given by 


b'TA 


— x(t) (C.24) 
b’TA+A 


e, (t) =—- 


where T is the positive definite solution of the Algebraic Riccati Equation (Åström 
and Wittenmark 1997): 


A'TA-T-A'Tb(b'Tb+4) 1b TAt+c7c=0 (C.25) 


The existence and unicity of the solution for Equation C.25 is guaranteed by the 
following conditions: 

The pair (A,B) is stabilizable 

The pair (A,C) is detectable 
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Since the state is not measurable, the certainty equivalence principle will be used 
and the non-accessible states will be replaced by the estimated states given by 
Equation C.8. A two degrees of freedom RST controller will be obtained just by 
replacing the controller gains in Equation C.3 by those resulting from Equation 
C.24. 

For further details on this control strategy see Landau et al. (1997); Åström and 
Wittenmark (1997). 


C.3 Notes and References 


State space approach for the design of digital controllers is presented in many 
books. We mention: 


Astrém K.J., Wittenmark B. (1997) Computer-Controlled Systems, Theory and 
Design, 3rd edition, Prentice Hall, NJ. 

Phillips C.L., Troy Nagel H. (1997) Digital Control System Analysis and Design, 
3rd edition, Prentice Hall, NJ. 

Goodwin G.C., Sin K.S. (1984) Adaptive Filtering Prediction and Control, 
Prentice Hall, NJ. 

Franklin G.F., Powell J.D., Workman M. (2000) Digital Control of Dynamic 
Systems, 3rd edition, Addison Wesley, CA. 

Landau I.D., Lozano R., M’Saad M. (1997) Adaptive Control, Springer, London, 
UK. 


D 


Generalized Stability Margin and Normalized Distance 
Between Two Transfer Functions 


D.1 Generalized Stability Margin 


In Chapter 2, Section 2.6.2 we presented the modulus margin, which gives the 
minimum distance between the Nyquist plot of the open loop transfer function and 
the critical point [-/, j0] and is a good indicator of the robustness of the closed loop 
system. The modulus margin has the expression 


s- 


Effectively the maximum of the modulus of a transfer function corresponds to “H 
infinity norm” and is denoted H,,. In other words the modulus margin is the 


Spe , forw=O0toz f (D.1) 


-1 
SEa] = 


inverse of the H „ norm of the output sensitivity function. 


In Section 2.6 it has also been mentioned that stability of the closed loop 
system requires that all the sensitivity functions be asymptotically stable. 
Furthermore it was shown in Section 2.6 that the uncertainties tolerated on the 
plant model depend upon the sensitivity functions. More specifically, the 
admissible uncertainties will be smaller as the maximum of the modulus of the 
various sensitivity functions grows. 

One can ask if it is not possible to give a global characterization of the stability 
margin of a closed loop system and its robustness, taking simultaneously into 
account all the four sensitivity functions. This problem can be viewed as the 
generalization of the modulus margin. 
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Denoting the controller by 


_ R(z') 


= (D.2) 
S@*) 
and the transfer function of the plant model by 
-d py, -l 
G= u R (D.3) 
A(z) 


one defines for the closed loop system (K,G) the matrix of sensitivity functions 


(z=e!”) 
S,.(j@) S (jo 
iga ee (D4) 
—SiypVG@) Spo) 
where S.,.,5.,,,5,,,,5,, have been defined in Chapter 2, Section 2.5 (Equations 
yr? yw? up? yp 


2.5.14 through 2.5.18). 
In order to be able to give an interpretation similar to the modulus of a transfer 
function, one should factorize the matrixT(j@)in the form (singular value 


decomposition) 


T(ja) = US(jo)V" (D.5) 


where U and V are orthonormal (unit) matrices with the property that 
UU’ =U'U=I, VV’ =V'V = I (* indicates the complex conjugate) and 


o\(jo) 0 0 0 
cok, 0 0,(jo) 0 0 
SU®)=! 0 o(ja) 0 @6) 
0 0 0 o,Jo) 


is a diagonal matrix (of transfer functions), with the property 
lo, (jo)|= loz( jo)|> lo3( jo)| = |o4( jo from @=0tor f, (D.7) 
o (jo) is called “the largest singular value of T( jæ)” and it is denoted by 


o( jo) =0,(jo) (D.8) 
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One defines the modulus of T(ja@) as follows: 


IT jo)| =F) (D.9) 
and the maximum of the modulus of T(j@) as 


TO) ax = Eo) pa = [To], 2 for ®=Oton Ís (D. 10) 


Similarly to the modulus margin, one defines the generalized stability margin as 


-1 
b(K,G) = oes =|T(jo)|; if (K,G)is stable (D.11) 
0 if (K,G) is unstable 


The generalized stability margin can be computed with the function smarg.m from 
the toolbox REDUC® (Adaptech 1999a)!. 
As the value of b(K,G) decreases, the closed loop system will be close to 


instability and it will be less robust with respect to the variations (or uncertainties) 
of the plant nominal transfer function. 

In what follows it will be shown that the generalized stability margin allows 
one to characterize the tolerated uncertainties on the plant transfer function for 
which the closed loop remains stable. To do this, first it is necessary to introduce 
the concept of normalized distance between two transfer functions. 


D.2 Normalized Distance Between Two Transfer Functions 


Consider a transfer function G. Let denotes the number of unstable zeros by 
n, and the number of unstable poles byn, . The number of encirclements of the 


origin of the complex plane is given by 
wno (G) =n, (G)- n, (G) (D.12) 


(positive value = counter clockwise encirclements; negative value = clockwise 
encirclements.). It is possible to compare two transfer functions G, G, only if 
they satisfy the following property: 


wno (1+ G,G,) +n, (G,)—n, (Gy)—np(G,) =0 (D.13) 


1 To be downloaded from the book website. 
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where G3 is the complex conjugate of G, and np(G,)is the number of poles 


G, located on the unit circle’. 


The normalized distance between two transfer functions satisfying the property 
of Equation D.13 is called the Vinnicombe distance or v —gap (Vinnicombe 1993). 
Let defines the normalized difference between two transfer functions G,(j@) 


and G,(j@)as 


(D.14) 


¥[G, (jo), G,(jo)]= Te = 
lago) ) l+e o) } 


The normalized distance (Vinnicombe distance) is defined by 
=|!"16,( jo), G,(jo)]IL, 


a (D.15) 
for o=O0ton f, 


8,(G,,G,) =| ¥[G,( jo), G,( jo)]| 


One observes immediately from the structure of Y that 
0<06,(G,,G))<1 (D.16) 
If the condition of Equation D.13 is not satisfied, by definition 


6, (Gi, G2) =] 


The Vinnicombe distance can be computed with the function smarg.m from the 
toolbox REDUC® (Adaptech 1999a)°. 


D.3 Robust Stability Condition 
Using the generalized stability margin and the Vinnicombe distance between two 


transfer functions, one can express a robust stability condition (sufficient 
condition) for a controller K designed on the basis of the nominal model G, as 


follows. Controller K which stabilizes model G, will also stabilize model G, if 


ô, (Gi, G2) <b(K,G,) (D.17) 


2 The condition of Equation D.13 is less restrictive than the condition used in Section 2.6 where two 
transfer functions with the same number of unstable poles and with the same number of encirclements 
of the origin have been considered. 

3 To be downloaded from the book website. 
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This condition can be replaced by a less restrictive condition, but which should be 
verified at all frequencies: 


| Y1IG,(jo),G,(jo)]|<|T(jo)- for o=010 nf, (D.18) 


D.4 Notes and References 


The concepts of Vinnicombe distance (v —gap) and generalized stability margin are 

extremely useful in practice since with one number it is possible to characterize 

either the distance between two transfer functions or the robustness of a controller. 

The original reference is: 

Vinnicombe G. (1993) Frequency domain uncertainty and the graph topology, 
IEEE Trans. on Automatic Control, vol. 38, no. 9, pp. 1371-1383. 


For a good pedagogical presentation, but with extensive use of the H „ norm, see : 


Zhu K.,(1998) Essentials of robust control, Prentice Hall, N.J., U.S.A. 


These concepts have been very useful for various applications. In particular they 
have been used for the validation of controllers resulting from controller reduction 
techniques (see Chapter 10) and for the validation of models identified in closed 
loop (see Chapter 9). Details and examples can be found in : 


Landau I.D., Karimi A., Constantinescu A. (2001) Direct controller reduction by 
identification in closed loop, Automatica, vol. 37, no. 11, pp. 1689-1702. 

Adaptech (19992) REDUC® — Controller order reduction by closed-loop 
identification (Toolbox for MATLAB"), Adaptech, 4 rue de la Tour de l’Eau, 
St. Martin d’Héres, France. 


4 This condition has to be compared with the conditions given in Section 2.6.2 (Equations 2.6.7, 2.6.9 
and 2.6.10). Equation D.18 can be interpreted as a generalization of these conditions. 
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The Youla—Kuéera Controller Parametrization 


E.1 Controller Parametrization 


The Youla-Kucera parametrization allows characterizing the set of all stabilizing 
controllers for a given plant model. This result has interesting implications in the 
design of RST controllers. 

Let consider a plant model characterized by the transfer function 


z 4B(z"') 


le erm 


(E.1) 


a stabilizing controller Rp (z')/ Soe) also termed the “central controller” and an 
asymptotically stable rational proper function 


= 
ge) - #2? (E.2) 


a(z') 


The poles of the closed loop when using the central controller are defined by the 
polynomial 


P= AS) +z “BR, (E.3) 


Youla — Kucera Parametrization 
All rational stabilizing controllers for the plant model G(z~') are given by : 


R(z') Ry + AO 
S(z") Sgoz "BO 


(E.4) 


457 


458 The Youla—Kuéera Controller Parametrization 


This controller will lead to the following expression of the polynomial defining the 
closed loop poles: 


A(QS,y — Bz“ B) +z“ B(aR, + AB) = a( AS, +z“ BRy) (E.5) 


Comparing Equation E.5 with Equation E.3 and taking in account the hypotheses 
made upon Q(z™'), it results that the closed loop poles will be asymptotically 


stable. One can also see that the denominator of Q(z ')appears in the 


characteristic polynomial defining the closed loop poles (i.e. it can serve to 
introduce additional poles at the desired location). 

The structure of the Youla—Kuéera parametrized controller is shown in Figure 
E.1. 


Figure A.5.1. The Youla — Kucera RST parametrized controller 


For a review of Youla-Kučera parametrization see Anderson (1998). We will 
briefly present next the implications of the Youla-Kučera parametrization in the 
design of RST controllers. Let assume that a central controller has been designed 
such that the closed loop is asymptotically stable and that we are looking to the 
redesign of the controller in order to achieve some objectives but without re- 


computing the central controller. Instead we will tune Q(z’) in order to achieve 


the desired properties of the closed loop. We will examine next some of these 
situations. 


Introduction of Auxiliary Poles (for Robustness) 
From Equation E.5 one can see that desired additional auxiliary poles can be 
introduced by taking 


1o 1l 
az") Ppl’) 


Qz’) = (E.6) 
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Affine Parametrization of the Sensitivity Functions 
Using the Q polynomial given in Equation E.2, the sensitivity functions given in 
Chapter 2, Equations 2.5.14 through 2.5.16 and 2.5.18 will take the form: 


AS AS) oe q‘B 
Sep pp 280-2 
AR AR A A 
Sip = = 0 Q Supo ~ Q 
P P P P ED 
r q BR q “BR, A o=s A o 
i P P P Wig p 
-d -d =d 
5 q` BS q°BSy q°B O=-S q B Q 
» PpP P P wo P 


One distinguishes two cases : 


Q= B(z'); alz") =1: this allows tuning the sensitivity functions by using the 
coefficients of B(z') without modifying the closed loop poles 

Q= Bz) a(z') : this allows tuning the sensitivity functions by using the 
coefficients of (z) and by modifying the auxiliary poles using the 


coefficients of polynomial a(z~') 


Automatic tuning of the sensitivity functions taking advantage of this affine 
parametrization can be done by convex optimization. See Boyd and Barratt (1991); 
Rantzer and Megretsky (1994); Langer and Landau (1999). 


Introduction and Tuning of thelnternal Model in the Controller Without Changing 
the Closed Loop Poles 

In the context of RST controllers the internal model corresponding to the 
disturbance model is the polynomial Hs (see Chapter 3), which is a factor of 
polynomial S. But the internal model can be alternatively introduced using the 
Youla-Kuéera parametrization. In fact one should select B such that 


S=S'Hs =S)-z “BB (E.8) 


In order to leave unchanged the poles of the closed loop one should take 
a(z')=land £(z7') should satisfy the following polynomial equations resulting 
from the condition of Equation E.8 : 


S'H5+-z “BB = So (E.9) 
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where z“B,H s and Sọ are known and pand S’ are unknown. The order of the 
polynomial Sp is 


Ng, Sng tng +d-1 


and therefore 


Ng =Ny l; ng =ngt+d—1. 


This allows determination of the order and coefficients of the polynomial 
Bz") = Bot Bez +.. See Tsypkin (1997); Landau et al. (2005). 


E.2 Notes and References 


For a tutorial on the Youla-Kuéera parametrization see: 


Anderson B.D.O. (1998) From Youla Kuéera to identification, adaptive and 
nonlinear control, Automatica vol. 34, 1485-1506. 


For the use of the Youla-Kuéera parametrization in convex optimization see: 


Boyd St.P, Barratt C.H. (1991) Linear controller design. Limits of performance, 
Prentice Hall, Englewood Cliffs. 

Langer J., Landau I.D. (1999) Combined pole placement/sensitivity function 
shaping method using convex optimization criteria, Automatica, vol.35, 1111- 
1120. 

Rantzer A., Megretski A. (1994) A convex parametrization of robustly stabilizing 
controllers, IEEE Trans. Aut. Control. Vol. 39, pp. 1802-1808. 


For the introduction of the internal model in Youla-Kuéera parametrized 
controllers see: 


Tsypkin Y.Z. (1997) Stochastic discrete systems with internal models, Journal of 
Automation and information Sciences, Vol. 29 pp. 156-161. 

Landau I.D., Constantinescu A., Rey D. (2005) Adaptive narrow band disturbance 
rejection applied to an active suspension — an internal model approach, 
Automatica vol. 41, no.4. 


F 


The Adaptation Gain Updating — The U-D 
Factorization 


F.1 The U-D Factorization 


The adaptation gain given by Equation 5.2.73 is in principle sensitive to round-off 
errors, in particular if the number of samples to be processed is very high (typical 
situation encountered in real time applications). The objective is to preserve the 
positive definite property of the adaption gain matrix despite round-off errors. This 
problem is comprehensively discussed in Bierman (1977) where the U-D 
factorization has been developed in order to ensure the numerical robustness of the 
adaptation gain. To this end the adaptation gain matrix is rewritten as follows: 


F(t)=U(®)D(HU(t)!" (F.1) 
where U(t) is an upper triangular matrix with all diagonal elements equal to 1 and 
D(t) is a diagonal matrix (with positive elements). This allows the adaptation gain 
matrix to remain positive definite despite the presence of the rounding errors. 


Let 


G(t) = DW (t) 


V(t) =U(t)' DA) (F.2) 
B(t)=14V(t)" G(t) 
AM r 
lt) = LO +V GE) 
Define: 
ry - LOGO ___ FOON (F.3) 


Bt) 1O FOO) 
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The U-D factorization algorithm for adaptation gain updating is given next. 
Initialize U(0) and D(0) at time t=0. This provides the initial value of the 
adaptation gain matrix F(0) = U(0)D(0)U(0)’. At time t+1, compute FTA while 
updating D(t+/) and U(t+/) by performing the following steps 
e Compute V(t), GHÒ, B, =1 and 6, =4(6)/4 (0); 


° For j=/ to n, (number of parameters) compute 


PO =La OV OG, 
6,(t1)=6,,()4+V, AGA) 
5,4(t) 
5 (DAO 

D.()=G,() 
AG) 
5,40 
If j#/ then 
For i=/ to j-7 compute 
U, (t+) =U, (+TM (A 
PO=F0+U,0O°,0 


D,(t+)= D, (0) 


M (t)=- 


end 
end 
end 
° For i=/ to n, do 


=F) 


1 
2, © 
end 
A lower bound on the adaptation gain is simply obtained by maintaining the 
values of the elements of the diagonal matrix D(t) above some specified threshold. 
The U-D algorithm is implemented in the function: udrls.m (MATLAB®) (see 


the book website). 


F.2 Notes and References 


Bierman, G. (1977) Factorization methods for discrete sequential estimation, 
Academic Press, New York. 

Landau I.D., Lozano R., M’Saad M. (1997) Adaptive control, Springer, London, 
U.K. 


G 


Laboratory Sessions 


In this appendix we propose several laboratory sessions in order to help the reader 
to become familiar with the techniques presented in this book. The sessions 
described in this Appendix can be worked out with the help of the MATLAB® and 
Scilab control design and identification functions and toolboxes available from the 
book website (hhtp://landau-bookic.lag.ensieg.inpg.fr). Additional laboratory 
sessions can be developed by the reader from the examples and applications 
presented in Chapters 3, 4, 7, 8 and 9. Other laboratory sessions are described on 
the book website. 


G.1 Sampled-data Systems 
Objective 


To become familiar with the discrete-time representation of a physical system. 


Functions to be used: cont2disc.m  (cont2disc.sci) and standard 
MATLAB“ /Scilab functions. 


Sequence of operations 


1. Study the step response of the first-order discrete-time model 
corresponding to the ZOH discretization of a first-order continuous-time 
model G/(/+ ts): 


-1 
bız 


H(z) = - 


l+az` 
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for ay = -0.2 ; -0.5 ; -0.7 ; -0.9 by choosing b; such that the static gain 
b;/(1 + a7) = 1 for all models. Superimpose the curves obtained on the 


same plot for an easy comparison. 
2. Find for all models the equivalent time constant (normalized with respect 
to the sampling period). 


Reminder: the time constant is equal to the time necessary to reach the 63% 
of the final value. 
3. Question: Does a, = - 0.2 correspond to a fast sampling of a continuous 


time first order system, or to a slow one ? 
Same question for a, = - 0.9. 


4. What are the approximated values for a, if the sampling periods 
T, =T /4 and T, = T (T= time constant) are chosen? 
5. Study the response in time domain for a, = 0.5 and 0.7. Give an 


interpretation of the results. 

6. Study the effect caused by the sampling period and the fractional delay on 
the discrete time model obtained by discretizing with a ZOH the following 
system: 


—sL 
H(s) = Ge 


1l+sT 


forG = 1, T= 10s; L=0, 0.58 ; 1s ; 2s ; 3s and T, = 5s and 10s. 
Analyze the properties of poles and zeros of the pulse transfer function for 
all models. 


G.2 Digital PID Controller 


Objective 
To become familiar with the digital PID and to emphasize the importance of using 
a three-branched digital controller (RST). 

Functions to be used: cont2disc.m (cont2disc.sci), bezoutd.m (bezoutd.sci) and 
standard MATLAB"/Scilab functions. 


Sequence of operations 


1. Find the discrete-time model from the ZOH discretization of 


Ge™ 
l+sT 


A(s)= for G=1,T =10s, L =3s and T, = 5s 
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2. Find the digital PID1! controller with a continuous-time equivalent 
which provides the best performances, corresponding to a second 
order system with a damping equal to 0.8. 

3. Once the PID is computed, perform a simulation of the closed loop in 
the time domain. Use a rectangular wave as reference. 

Is it possible to obtain a closed loop response faster than the open 
loop response for this ratio of time delay/time constant equal to 0.3? 

4. Find the digital PID1 with no continuous time equivalent that provides 
a closed loop rise time approximately equal to half of the open loop 
one. 

5. Perform a simulation in the time domain. Explain the possible 
overshoot from the values of R(q~’). 

6. In the same conditions as the point 4, compare the digital PID 
controllers type 1 and 2. 


G.3 System Identification 


Objectives 
Session G.3-1: to become familiar with the recursive parameter identification 
methods and the model validation procedures. 


Session G.3-2: to identify two real systems (a distillation column and a flexible 
robot arm) directly from I/O data. 


Functions to be used: rls.m, rels.m, oloe.m, afoloe.m, foloe.m, estorderiv.m, 
vimaux.m, xoloe.m, olvalid.m (or the corresponding Scilab functions) and standard 
MATLAB /Scilab functions. 


Session G.3-1 

Data files 

The files to be used are TO, T1 and XQ, each one containing 256 I/O samples?. 
The files should be centered. 


The input signal is a PRBS generated by a shift register with N = 8 cells. The 
file TO has been obtained by simulating the following model: 


A(q!) y(t) =q Bq uÀ; u - input, y - output 


Aq!) =1-1.5q1+0.7q? ; Bg)=1¢'+05q7; d=1 


l! Digital PID 1 and 2 controllers are presented in Chapter 3, Section 3.2. 
? Files available on the website: http//:landau-bookic.lag.ensieg.inpg. fr. 
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The file T1 has been generated with the same polynomials A and B, but a stochastic 
disturbance has been added to the model output. 
The file XQ is given with no a priori information (degree of A <5). 


Sequence of operations 


1. Use structure 1 and the RLS (Recursive Least Squares) method with a 
decreasing adaptation gain to identify the model corresponding to TO 
(with na = 2, ng = 2, d= 1). 

2. Try with degrees B = 4 and d = 0 on the same file TO using the same 
algorithm previously used, to see how a pure time delay can be found 
out (the first coefficient of B is much smaller than the second one). 

3. Identify the model corresponding to the file T1 using structure 1 and 
the recursive least squares method with a decreasing adaptation gain 
(as for TO). Note the bias of the identified parameters. Try to validate 
the model identified. 

4. Try other structures and methods to improve the results (S3 then S2). 

5. When a satisfactory validation is obtained, compute and plot the step 
response. 

6. Perform a complexity estimation (values of n,,ng,d) with the 


different methods described in Chapters 6 and 7. 
7. Identify the model corresponding to XQ. 


Session G.3-2 


Data files: QXD, ROB2 

QXD: this file contains 256 I/O samples that describe the interaction between the 
heating power on the bottom of a binary distillation column and the concentration 
of product on the top. The input signal is a PRBS generated by a shift register with 
eight cells. The sampling period is 10 s. A priori knowledge: for the distillation 
columns the degree of polynomial A is generally not greater than 3. The file has to 
be centered. 


Sequence of operations 
Identify the model(s) corresponding to the I/O data set, validate the models 
identified, and plot the step response(s). 


Question 1: what is the value of the plant rise time? 
Question 2: has the PRBS been correctly chosen with respect to the rise time? 


ROB2: 256 I/O samples corresponding to a very flexible robot arm. Input: motor 
torque. Output: robot arm end position. The input signal is a PRBS. The sampling 
frequency is 5 Hz. Any vibration mode over 2.5 Hz has been eliminated by an anti- 
aliasing filter. A priori knowledge: in the frequency region from 0 to 2.5 Hz, there 
are two vibration modes. The file has to be centered. 
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Sequence of operations 
Identify the model(s) corresponding to the I/O data set, validate the models 
identified, and plot the frequency responses (= 200 points). 


Question 1: at what frequencies are the vibration modes? What are the 
corresponding damping factors? 


Question 2: what are the differences between the frequency responses of a 
validated model and of a model which does not pass the validation test? 


G.4 Digital Control (Distillation Column Control Design) 


Objective 
The purpose of this session is to apply the control algorithms presented in Chapter 
3 to the distillation column case study (file QXD), and to evaluate the 
performances in simulation. 

We consider two different models for the distillation column, corresponding to 
a time delay d = 1, and d = 2 respectively (the sampling period is 10 s). Digital 
controllers will be computed for both models, and the controllers robustness will 
be tested by carrying on crossed simulations (Model 1 with controller 2 and Model 
2 with controller 1). The models are the following: 


d=1 
MI: 4 (q4) =1-0.5065 q! — 0.1595 q? 
B (q!) = 0.0908 q} + 0.1612 q? + 0.0776 q’ 


d=2 
M2: A(q/) =1-0.589 q!- 0.098 q? 
B (q1) = 0.202 q4+0.0807 q? 


Functions to be used: bezoutd.m, cont2disc.m, omega_dmp.m, fd2pol.m (or the 
corresponding Scilab functions) and standard MATLAB*/Scilab functions. 


Sequence of operations 


1. Design a digital controller (with integrator) for the model M1 (then for 
the model M2) of the distillation column. 
This operation can be carried on by using a deterministic control 
algorithm well suited to the model used (depending on the zeros 
position with respect to the unit circle). 
The desired closed loop dynamics (regulation) is specified by a 
second-order system, with damping factor equal to 0.9, such that the 
closed loop rise time be 20% shorter than the open loop rise time. The 
dynamics specified for the tracking performances is the same as for 
the regulation. 

2. Compute the controller that guarantees the performances specified 
above and the robustness margins AM 20.5, At 2 10s =T,. 
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3. Perform cross-simulation tests with both controllers and both models. 
Give an interpretation of the results. 

4. Repeat the sequence of operations to design a controller assuring an 
acceleration (reduction) of 50% of the closed loop rise time compared 
to the open loop system, an overshoot less than 5% (both tracking and 
regulation), and satisfying the robustness margins (AM 20.5, 
Ar2=10s). If both performance and robustness cannot be 
simultaneously satisfied, select the desired closed loop dynamics such 
that the resulting robustness margins match the specifications. 
Question: is it possible to assure the robustness requirements with this 
specification for the regulation dynamics (acceleration of 50%)? 

5. Perform cross-simulation tests with both controllers and both models. 
Give an interpretation of the results. Do a comparison with the 
previous case. 


G.5 Closed Loop Identification 


Objective 
To introduce the closed loop identification algorithms. This is carried on with a 
simulated closed loop system. 


Functions to be used: functions contained in the CLID" toolbox. 


Data files: the file simubf.mat contains the external excitation r, the input u and 
the output y of the plant. The external excitation is a PRBS applied on the 
reference. The file simubf_rst.mat contains the parameters of the RST controller. 
The simulated plant model to be identified is characterized 
by: ny =2,nz =2,d =0. 


Sequence of operations 


1. Identify and validate a model with open loop identification techniques 
(from u to y) ignoring the feedback. 

2. Identify plant models with different closed loop identification 
algorithms and the given digital controller. Validate the model. 
Compare the various models on the basis of validation results. 

3. Compare the models obtained with an open loop identification 
technique with the models obtained with the closed loop identification 
algorithms. Check the closed loop poles proximity (between the 
identified closed loop poles and the computed ones using both open 
loop and closed loop identified models). 

4. Plot the step responses and the frequency responses for the identified 
models. 
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G.6 Controller Reduction 


Objective 

To focus attention on controllers’ complexity, and to present an effective solution 
to the controller implementation in the case of strict constraints imposed by the 
available resources. The flexible transmission example will be studied and a 
reduced order controller will be estimated. 


Functions to be used: functions contained in the REDUC? toolbox. 


Data files: the file flex_prbs.mat contains the external excitation ; the file 
BF _RST.mat contains the parameters of the RST controller 
(Np =Ng =5,T = R(1)); the file BF_mod.mat contains the discrete-time model of 


the plant. 
Sequence of operations 


1. Compute the simulated control signal on the basis of the given closed 
loop system (will be used in the estimation algorithms). Use the 
appropriate sensitivity function with respect to the reduction algorithm 
to be used (Closed Input Matching (S,,) and Closed Loop Output 
Matching (S,,.). 

2. Find a reduced order RST controller with npg =ny =3,T = R(1) 
starting from the given one. Validate the resulting controller. 

3. Impose ngę=nçş=2,T = R(l)in order to get a digital controller 


corresponding to a digital PID 2 controller. 

4. Compare the results obtained with the two methods (CLIM and 
CLOM). Give an interpretation. 

5. Plot the response for a step reference change and a step disturbance on 
the output for the closed loop system with the nominal controller and 
the reduced controllers. 


H 


List of Functions (MATLAB*, Scilab and C**) 


All functions listed in the table below are available on the website : http ://landau- 
bookic.lag.ensieg.inpg.fr. 


Scilab MATLAB® Cc” Description 
Function Function | function 
bezoutd.sci bezoutd.m Bezout equation (P=ASjHs+BRoHre ) 


solution 


cont2disc.sci 


cont2disc.m 


Continuous-time to discrete-time transfer 
function conversion (F(s) > F(z)) with 
Zero Order Hold 


fd2pol.sci 


fd2pol.m 


Second-order discrete-time system 
computation from second-order 
continuous-time system natural frequency 
and damping factor 


omega_dmp.s 
ci 


omega_dmp.m 


Computation of natural frequency and 
damping factor for a second-order 
continuous-time system from desired rise 
time and overshoot 


predisol.sci 


predisol.m 


Predictor equation solution 


nyquist_ol.sci 


nyquist_ol.m 


Nyquist plot 


filter22.sci 


filter22.m 


Resonant zero-pole filter computation 


ppmaster.zip 


Pole placement digital control design 


reduc.zip 


Reduction of controller complexity 


clid.zip 


Closed loop system identification 


estorderls.sci 


estorderls.m 


Complexity estimation with the least 
squares criterion 


estorderiv.sci 


estorderiv.m 


Complexity estimation with the 
instrumental variable criterion 


nrls.sci nrls .m Non-recursive least squares 
rls.sci rls.m Recursive least squares 
udrls.m U-D factorized recursive least squares 
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472 List of Functions (MATLAB®, Scilab and (om) 


rels.sci rels.m Recursive extended least squares 
oloe.sci oloe.sci Output error (recursive) 
vi_maux.sci vi_maux.m Instrumental variable with auxiliary 
model 
foloe.sci foloe.m Output error with filtered observations 
afoloe.sci afoloe.m Output error with adaptive filtered 
observations 
xoloe.sci xoloe.m Output error with extended prediction 
model 
olvalid.m Open loop model validation 
prbs.m prbs.c Pseudo random binary sequence 
generation 
rst.c RST controller algorithm 


Polynomials (A,B, R, ...) are considered in MATLAB® environment as vectors of 
coefficients. In Scilab the object “polynomial” is directly available. However, in 
order to have uniformity in polynomials processing, polynomials must be defined 
as vectors of coefficients to be used as inputs of Scilab functions. In the same way, 
the outputs of the Scilab functions are vectors of coefficients instead of the object 
“polynomial”. 


Appendix I 
MIRCOD (Model Identification and Robust COntroller Design) 


MIRCOD (Model Identification and Robust COntroller Design) is a software for the 
identification of the single input / single output systems and the design of robust controllers 
for this type of systems. It has a graphical user interface. It proposes techniques for system 
identification in open loop and closed loop operation. The design of the controllers is done by 
combining pole placement with the shaping of the sensitivity functions. 

It has been developed by T. B. Airimitoaie in order to implement the identification and 
control techniques provided in the book. The MIRCOD software was develpped for Microsoft 
Windows (Windows 7). 


To start MIRCOD one needs to double click on MIRCOD.exe. The screen shown below will 
appear. 


One then select the corresponding buttons associated with the various functions 
(identification, control design, reduction of the controller complexity). 


Identification | Controller design Controller reduction 


[LFR.) Cen) Help -> Open “Manual 


EEA | Save workspace Load workspace MIRCOD. pdf” 


MIRCOD is available on the web site : http://tudor.bogdan.airimitoaie.name/mircod.html 


Contact: tudor-bogdan.airimitoaie@u-bordeaux.fr 
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